7 |
9 | {{ page.title }}
8 |
10 |
11 | {{ content }}
12 |
13 |
14 |
15 |
16 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_layouts/archive.html:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default
3 | type: archive
4 | ---
5 |
6 |
7 |
9 | {{ page.title }}
8 |
10 |
11 | {{ content }}
12 |
13 |
14 |
15 |
16 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/additional.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default
3 | title: Additional Tools
4 | permalink: '/additional.html'
5 | nav_order: 5
6 | has_children: true
7 | ---
8 |
9 | # Additional Tools
10 |
11 | In this section we discuss additional tools beyond the CoreNLP pipeline.
12 |
13 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/resources.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default
3 | title: Resources
4 | permalink: '/resources.html'
5 | nav_order: 6
6 | has_children: true
7 | ---
8 |
9 | # Resources
10 |
11 | In this section, we include additional resources that might be helpful for you when using CoreNLP.
12 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_layouts/page.html:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default
3 | toc: true
4 | ---
5 |
6 | {{ page.title }}
7 | 8 | {% if page.toc != false %} 9 |Table of contents
10 | 11 |
12 | {% include toc.html html=content %}
13 |
14 |
15 | 16 | {% endif %} 17 | 18 | {{ content }} 19 | -------------------------------------------------------------------------------- /CoreNLP-gh-pages/_layouts/tag_page.html: -------------------------------------------------------------------------------- 1 | --- 2 | layout: default 3 | --- 4 |
{{ page.tag }}
5 |-
6 | {% for post in page.posts %}
7 |
- {{ post.title }} ({{ post.date | date_to_string }} | Tags: {{ post | tags }}) 8 | {% endfor %} 9 |
12 | {{ site | tag_cloud }}
13 |
--------------------------------------------------------------------------------
/Single_Cycle_CPU/Single_cycle_implementation/imem.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 |
3 | //IMEM module
4 |
5 | module imem(
6 | input [31:0] iaddr,
7 | output [31:0] idata
8 | );
9 | reg [31:0] i_arr[0:31];
10 | initial begin
11 | $readmemh("imem1_ini.mem",i_arr);
12 | //$readmemh("imem5_ini.mem",i_arr);
13 | end
14 | assign idata = i_arr[iaddr[31:2]];
15 | endmodule
16 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/utilities/_lists.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Utility classes for lists
3 | //
4 |
5 | // stylelint-disable primer/selector-no-utility, primer/no-override, selector-max-type
6 |
7 | .list-style-none {
8 | padding: 0 !important;
9 | margin: 0 !important;
10 | list-style: none !important;
11 |
12 | li {
13 | &::before {
14 | display: none !important;
15 | }
16 | }
17 | }
18 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_layouts/page_print.html:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default_print
3 | comments: true
4 | ---
5 |
6 |
8 |
9 |
10 |
11 | {{ page.title }}
7 |
12 |
13 | {% if page.summary %}
14 |
18 |
19 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/usage.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default
3 | title: Usage
4 | permalink: '/usage.html'
5 | nav_order: 2
6 | has_children: true
7 | ---
8 |
9 | # Usage
10 |
11 | In this section we cover getting started with CoreNLP and different usage modes. CoreNLP can be used via the command line, in Java code, or with calls to a server, and can be run on multiple languages including Arabic, Chinese, English, French, German, and Spanish.
12 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/patterns.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Bootstrapped surface patterns
4 | keywords: patterns
5 | permalink: '/patterns.html'
6 | nav_order: 1
7 | toc: false
8 | parent: Additional Tools
9 | ---
10 |
11 | StanfordCoreNLP includes [Bootstrapped Pattern Learning](http://nlp.stanford.edu/software/patternslearning.html), a framework for learning patterns to learn entities of given entity types from unlabeled text starting with seed sets of entities.
12 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/images/search.svg:
--------------------------------------------------------------------------------
1 |
2 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/custom/doc/series_acme_next.html:
--------------------------------------------------------------------------------
1 | {{page.summary}}
15 | {% endif %}
16 | {{ content }}
17 | {% assign series_pages = site.tags.series_acme %} 2 | {% for p in pages %} 3 | {% if p.series == "ACME series" %} 4 | {% assign nextTopic = page.weight | plus: "0.1" %} 5 | {% if p.weight == nextTopic %} 6 | 7 | {% endif %} 8 | {% endif %} 9 | {% endfor %} 10 |
11 | -------------------------------------------------------------------------------- /CoreNLP-gh-pages/_pages/demo.md: -------------------------------------------------------------------------------- 1 | --- 2 | layout: default 3 | title: Demo 4 | permalink: '/demo.html' 5 | nav_order: 3 6 | has_children: false 7 | --- 8 | 9 | # Demo 10 | 11 | There is a live online demo of CoreNLP available at [corenlp.run](https://corenlp.run). 12 | 13 |
14 | 
15 |
Note: {% endcapture %}
3 | {% capture important %}
Important: {% endcapture %}
4 | {% capture warning %} Feedback
17 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/LICENSE:
--------------------------------------------------------------------------------
1 | Copyright 2019 Leland Stanford Junior University
2 |
3 | Licensed under the Apache License, Version 2.0 (the "License");
4 | you may not use this file except in compliance with the License.
5 | You may obtain a copy of the License at
6 |
7 | http://www.apache.org/licenses/LICENSE-2.0
8 |
9 | Unless required by applicable law or agreed to in writing, software
10 | distributed under the License is distributed on an "AS IS" BASIS,
11 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12 | See the License for the specific language governing permissions and
13 | limitations under the License.
14 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/404.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: default
3 | title: "Page Not Found"
4 | description: "Page not found."
5 | sitemap: false
6 | search: exclude
7 | related_pages: none
8 | nav_exclude: true
9 | search_exclude: true
10 | ---
11 |
12 | Sorry, but the page you were trying to view does not exist --- perhaps you can try searching for it.
13 |
14 | {%comment%}
15 |
19 |
22 | {%endcomment%}
23 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/frameescape.html:
--------------------------------------------------------------------------------
1 |
2 |
19 |
20 |
21 | Pop-out
22 |
23 |
24 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/callouts.html:
--------------------------------------------------------------------------------
1 | {% capture callout_danger %}
Warning: {% endcapture %}
5 | {% capture end %}
{% endcapture %}
6 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/head_custom.html:
--------------------------------------------------------------------------------
1 |
2 |
3 |
4 |
5 |
6 |
7 |
8 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/feedback.html:
--------------------------------------------------------------------------------
1 |
2 |
15 |
16 | {% endcapture %}
2 | {% capture callout_default %}
{% endcapture %}
3 | {% capture callout_primary %}
{% endcapture %}
4 | {% capture callout_success %}
{% endcapture %}
5 | {% capture callout_info %}
{% endcapture %}
6 | {% capture callout_warning %}
{% endcapture %}
7 |
8 | {% capture hr_faded %}
{%endcapture %} 9 | {% capture hr_shaded %}
{%endcapture %} -------------------------------------------------------------------------------- /Single_Cycle_CPU/Single_cycle_implementation/regfile.v: -------------------------------------------------------------------------------- 1 | `timescale 1ns / 1ps 2 | //Regfile module 3 | 4 | module regfile( 5 | input clk, 6 | input [4:0] rs1, 7 | input [4:0] rs2, 8 | input [4:0] rd, 9 | input [31:0] regdata, 10 | input wer, 11 | output [31:0] rv1, 12 | output [31:0] rv2, 13 | output [31:0] x31 14 | ); 15 | reg [31:0] r[0:31]; 16 | integer i; 17 | initial begin 18 | r[31] = 0; 19 | for(i=0; i<31; i = i+1) 20 | r[i]=i; 21 | end 22 | assign rv1 = r[rs1]; 23 | assign rv2 = r[rs2]; 24 | assign x31 = r[31]; 25 | always @(posedge clk) 26 | begin 27 | if(wer && rd!=0) 28 | r[rd] = regdata; 29 | end 30 | endmodule 31 | -------------------------------------------------------------------------------- /Pipelined_CPU/pipeline_CPU_tb.v: -------------------------------------------------------------------------------- 1 | `timescale 1ns / 1ps 2 | 3 | module pipeline_cpu_tb(); 4 | reg clk, reset; 5 | wire [31:0] iaddr; 6 | wire [31:0] x31; 7 | wire [31:0] EM_daddr_out; 8 | wire [31:0] MW_drdata_out; 9 | wire [31:0] L_regdata_out; 10 | 11 | pipeline_CPU dut( 12 | .clk(clk), 13 | .reset(reset), 14 | .iaddr(iaddr), 15 | .x31(x31), 16 | .EM_daddr_out(EM_daddr_out), 17 | .MW_drdata_out(MW_drdata_out), 18 | .L_regdata_out(L_regdata_out) 19 | ); 20 | 21 | always #5 clk = ~clk; 22 | initial begin 23 | clk = 0; 24 | reset = 1; 25 | #30; 26 | reset = 0; 27 | $finish; 28 | end 29 | endmodule 30 | -------------------------------------------------------------------------------- /CoreNLP-gh-pages/_sass/labels.scss: -------------------------------------------------------------------------------- 1 | // 2 | // Labels (not the form kind) 3 | // 4 | 5 | .label, 6 | .label-blue { 7 | display: inline-block; 8 | padding-top: 0.16em; 9 | padding-right: 0.42em; 10 | padding-bottom: 0.16em; 11 | padding-left: 0.42em; 12 | margin-right: $sp-1; 13 | margin-left: $sp-1; 14 | color: $white; 15 | text-transform: uppercase; 16 | vertical-align: middle; 17 | background-color: $blue-100; 18 | @include fs-2; 19 | } 20 | 21 | .label-green { 22 | background-color: $green-200; 23 | } 24 | 25 | .label-purple { 26 | background-color: $purple-100; 27 | } 28 | 29 | .label-red { 30 | background-color: $red-200; 31 | } 32 | 33 | .label-yellow { 34 | color: $grey-dk-200; 35 | background-color: $yellow-200; 36 | } 37 | -------------------------------------------------------------------------------- /Pipelined_Branch_Predict/cpu_tb.v: -------------------------------------------------------------------------------- 1 | `timescale 1ns / 1ps 2 | 3 | module pipeline_cpu_tb(); 4 | reg clk, reset; //check.. drdata and idata should be reg?????? 5 | wire [31:0] iaddr; 6 | wire [31:0] x31; 7 | wire [31:0] L_regdata_out; 8 | wire [31:0] EM_daddr_out; 9 | wire [31:0] MW_drdata_out; 10 | 11 | pipeline_CPU dut( 12 | .clk(clk), 13 | .reset(reset), 14 | .iaddr(iaddr), 15 | .x31(x31), 16 | .L_regdata_out(L_regdata_out), 17 | .EM_daddr_out(EM_daddr_out), 18 | .MW_drdata_out(MW_drdata_out) 19 | ); 20 | 21 | always #5 clk = ~clk; 22 | initial begin 23 | clk = 0; 24 | reset = 1; 25 | #30; 26 | reset = 0; 27 | $finish; 28 | end 29 | endmodule 30 | -------------------------------------------------------------------------------- /CoreNLP-gh-pages/_includes/taglogic.html: -------------------------------------------------------------------------------- 1 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/support/mixins/_buttons.scss:
--------------------------------------------------------------------------------
1 | // Colored button
2 |
3 | @mixin btn-color($fg, $bg) {
4 | color: $fg;
5 | background-color: darken($bg, 2%);
6 | background-image: linear-gradient(lighten($bg, 5%), darken($bg, 2%));
7 | box-shadow: 0 1px 3px rgba(0, 0, 0, 0.25), 0 4px 10px rgba(0, 0, 0, 0.12);
8 |
9 | &:hover,
10 | &.zeroclipboard-is-hover {
11 | color: $fg;
12 | background-color: darken($bg, 4%);
13 | background-image: linear-gradient((lighten($bg, 2%), darken($bg, 4%)));
14 | }
15 |
16 | &:active,
17 | &.selected,
18 | &.zeroclipboard-is-active {
19 | background-color: darken($bg, 5%);
20 | background-image: none;
21 | box-shadow: inset 0 2px 4px rgba(0, 0, 0, 0.15);
22 | }
23 |
24 | &.selected:hover {
25 | background-color: darken($bg, 10%);
26 | }
27 | }
28 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/custom/doc/series_acme.html:
--------------------------------------------------------------------------------
1 | =in2)? (iaddr+imm) : (iaddr+4);
20 | 3'b110: out = (tmp1=tmp2)? (iaddr+imm) : (iaddr+4);
22 | endcase
23 | end
24 | endmodule
25 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/disqus.html:
--------------------------------------------------------------------------------
1 | {% if site.disqus_shortname %}
2 |
3 |
4 |
15 |
16 | {% endif %}
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_data/topnav_doc.yml:
--------------------------------------------------------------------------------
1 | # Topnav single links
2 | # if you want to list an external url, use external_url instead of url. the theme will apply a different link base.
3 | topnav:
4 | - title: Topnav
5 | subcategories:
6 | - title: Github repo
7 | external_url: https://github.com/stanfordnlp/CoreNLP
8 | icon: fab fa-github
9 |
10 | #Topnav dropdowns
11 | topnav_dropdowns:
12 | - title: Topnav dropdowns
13 | subcategories:
14 | - title: Quick links
15 | icon: fas fa-bars
16 | items:
17 | - title: Publication
18 | external_url: https://arxiv.org/pdf/2003.07082.pdf
19 | icon: fas fa-file
20 | - title: Stanford CoreNLP (Java)
21 | external_url: https://stanfordnlp.github.io/CoreNLP
22 | icon: fas fa-toolbox
23 | - title: Stanford NLP Group
24 | external_url: https://nlp.stanford.edu/
25 | icon: fas fa-link
26 |
27 |
28 |
--------------------------------------------------------------------------------
/Single_Cycle_CPU/Single_cycle_implementation/dmem.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 | //DMEM module
3 |
4 | module dmem(
5 | input clk,
6 | input [31:0] daddr,
7 | input [31:0] dwdata,
8 | input [3:0] we,
9 | output [31:0] drdata
10 | );
11 | reg [7:0] m[0:127];
12 | wire [31:0] add0,add1,add2,add3;
13 | initial $readmemh("dmem_ini.mem",m);
14 |
15 | assign add0 = (daddr & 32'hfffffffc)+ 32'h00000000;
16 | assign add1 = (daddr & 32'hfffffffc)+ 32'h00000001;
17 | assign add2 = (daddr & 32'hfffffffc)+ 32'h00000002;
18 | assign add3 = (daddr & 32'hfffffffc)+ 32'h00000003;
19 |
20 | assign drdata = {m[add3], m[add2], m[add1], m[add0]};
21 |
22 | always@( posedge clk)
23 | begin
24 | if(we[0]==1)
25 | m[add0] = dwdata[7:0];
26 | if(we[1]==1)
27 | m[add1] = dwdata[15:8];
28 | if(we[2]==1)
29 | m[add2] = dwdata[23:16];
30 | if(we[3]==1)
31 | m[add3] = dwdata[31:24];
32 | end
33 | endmodule
--------------------------------------------------------------------------------
/Single_Cycle_CPU/Single_cycle_implementation/L_type.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 | //Module for Store instructions - data to be written to reg file is generated by this module
3 | module L_type(
4 | input [31:0] instr,
5 | input [31:0] daddr,
6 | input [31:0] drdata,
7 | output reg[31:0] out
8 | );
9 |
10 | reg [31:0] offset;
11 | always@(instr or daddr or drdata)
12 | begin
13 | offset = (daddr[1:0]<<3); //offset = 8*rv1[1:0]-1 ,eg, 8*1=8, so drdata[15:8]
14 | case(instr[14:12])
15 | 3'b000: out = {{24{drdata[offset+7]}}, drdata[offset +: 8]}; //LB
16 | 3'b001: out = {{16{drdata[offset+15]}}, drdata[offset +: 16]}; //LH
17 | 3'b010: out = drdata; //LW
18 | 3'b100: out = {24'b0, drdata[offset +: 8]}; //LBU
19 | 3'b101: out = {16'b0, drdata[offset +: 16]}; //LHU
20 | endcase
21 | end
22 | endmodule
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/typography.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Typography
3 | //
4 | // stylelint-disable primer/selector-no-utility, primer/no-override, selector-no-type, selector-max-type
5 |
6 | h1,
7 | .text-alpha {
8 | @include fs-8;
9 | font-weight: 300;
10 | }
11 |
12 | h2,
13 | .text-beta {
14 | @include fs-6;
15 | }
16 |
17 | h3,
18 | .text-gamma {
19 | @include fs-5;
20 | }
21 |
22 | h4,
23 | .text-delta {
24 | @include fs-2;
25 | font-weight: 300;
26 | text-transform: uppercase;
27 | letter-spacing: 0.1em;
28 | }
29 |
30 | h5,
31 | .text-epsilon {
32 | @include fs-3;
33 | color: $grey-dk-200;
34 | }
35 |
36 | h6,
37 | .text-zeta {
38 | @include fs-2;
39 | color: $grey-dk-200;
40 | }
41 |
42 | li {
43 | .highlight {
44 | margin-top: $sp-2;
45 | }
46 | }
47 |
48 | .text-small {
49 | @include fs-2;
50 | }
51 |
52 | .text-mono {
53 | font-family: $mono-font-family !important;
54 | }
55 |
56 | .text-center {
57 | text-align: center !important;
58 | }
59 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/css/dark-mode-preview.scss:
--------------------------------------------------------------------------------
1 | ---
2 | # this ensures Jekyll reads the file to be transformed into CSS later
3 | # only Main files contain this front matter, not partials.
4 | ---
5 |
6 | {% if site.logo %}
7 | $logo: "{{ site.logo | absolute_url }}";
8 | {% endif %}
9 |
10 | //
11 | // Import external dependencies
12 | //
13 |
14 | @import "./vendor/normalize.scss/normalize.scss";
15 |
16 | //
17 | // Import Just the Docs scss
18 | //
19 |
20 | // Support
21 | @import "./support/support";
22 |
23 | //
24 | // Import custom color scheme scss
25 | //
26 |
27 | @import "./color_schemes/dark.scss";
28 |
29 | // Modules
30 | @import "./base";
31 | @import "./layout";
32 | @import "./content";
33 | @import "./navigation";
34 | @import "./typography";
35 | @import "./labels";
36 | @import "./buttons";
37 | @import "./search";
38 | @import "./tables";
39 | @import "./code";
40 | @import "./utilities/utilities";
41 |
42 | //
43 | // Import custom overrides
44 | //
45 | @import "./custom/custom";
46 |
--------------------------------------------------------------------------------
/Single_Cycle_CPU/Single_cycle_implementation/R_type.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 |
3 | //R type instructions
4 | module R_type(
5 | input [31:0] instr,
6 | input signed [31:0] in1,
7 | input signed [31:0] in2,
8 | output reg[31:0] out
9 | );
10 | wire [31:0] tmp1;
11 | wire [31:0] tmp2;
12 | assign tmp1 = in1;
13 | assign tmp2 = in2;
14 |
15 | always @(instr or in1 or in2)
16 | begin
17 | case({instr[30],instr[14:12]})
18 | 4'b0000: out = in1+in2; //add
19 | 4'b1000: out = in1-in2; //sub
20 | 4'b0001: out = in1<>in2[4:0]; //srl
25 | 4'b1101: out = in1>>>in2[4:0]; //sra
26 | 4'b0110: out = in1|in2; //or
27 | 4'b0111: out = in1&in2; //and
28 | endcase
29 | end
30 | endmodule
31 |
--------------------------------------------------------------------------------
/Single_Cycle_CPU/Single_cycle_implementation/I_type.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 |
3 | //Module for immediate instructions
4 | module I_type(
5 | input [31:0] instr,
6 | input signed [31:0] in1,
7 | input signed [31:0] imm,
8 | output reg [31:0] out
9 | );
10 | wire [31:0] tmp1;
11 | wire [11:0] tmp2;
12 | assign tmp1 = in1;
13 | assign tmp2 = imm;
14 | always @(instr or in1 or imm)
15 | begin
16 | case(instr[14:12])
17 | 3'b000: out = in1+imm; //addi
18 | 3'b010: out = in1>imm[4:0];
28 | else //srai
29 | out = in1>>>imm[4:0];
30 | end
31 | endcase
32 | end
33 | endmodule
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/custom/conditions.html:
--------------------------------------------------------------------------------
1 | {% if site.project == "doc" %}
2 | {% assign audience = "writers" %}
3 | {% assign sidebar = site.data.sidebar_doc.entries %}
4 | {% assign topnav = site.data.topnav_doc.topnav %}
5 | {% assign topnav_dropdowns = site.data.topnav_doc.topnav_dropdowns %}
6 | {% assign version = "all" %}
7 | {% assign product = "all" %}
8 | {% assign platform = "php" %}
9 | {% assign link = "custom/doc/links_doc.html" %}
10 | {% assign projectTags = site.data.tags_doc.allowed-tags %}
11 | {% assign searchGroup = "doc" %}
12 | {% endif %}
13 |
14 | {% if site.project == "doc" %}
15 | {% assign audience = "designers" %}
16 | {% assign sidebar = site.data.sidebar_doc.entries %}
17 | {% assign topnav = site.data.topnav_doc.topnav %}
18 | {% assign topnav_dropdowns = site.data.topnav_doc.topnav_dropdowns %}
19 | {% assign version = "all" %}
20 | {% assign product = "all" %}
21 | {% assign platform = "all" %}
22 | {% assign link = "custom/doc/links_doc.html" %}
23 | {% assign projectTags = site.data.tags_doc.allowed-tags %}
24 | {% assign searchGroup = "doc" %}
25 | {% endif %}
26 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/css/just-the-docs.scss:
--------------------------------------------------------------------------------
1 | ---
2 | # this ensures Jekyll reads the file to be transformed into CSS later
3 | # only Main files contain this front matter, not partials.
4 | ---
5 |
6 | {% if site.logo %}
7 | $logo: "{{ site.logo | absolute_url }}";
8 | {% endif %}
9 |
10 | //
11 | // Import external dependencies
12 | //
13 |
14 | @import "./vendor/normalize.scss/normalize.scss";
15 |
16 | //
17 | // Import Just the Docs scss
18 | //
19 |
20 | // Support
21 | @import "./support/support";
22 |
23 | //
24 | // Import custom overrides
25 | //
26 |
27 | @import "./custom/custom";
28 |
29 | //
30 | // Import custom color scheme scss
31 | //
32 |
33 | {% if site.color_scheme == "dark" %}
34 | @import "./color_schemes/dark.scss";
35 | {% endif %}
36 |
37 | // Modules
38 | @import "./base";
39 | @import "./layout";
40 | @import "./content";
41 | @import "./navigation";
42 | @import "./typography";
43 | @import "./labels";
44 | @import "./buttons";
45 | @import "./search";
46 | @import "./tables";
47 | @import "./code";
48 | @import "./utilities/utilities";
49 | @import "./overrides";
50 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/js/dark-mode-preview.js:
--------------------------------------------------------------------------------
1 | document.addEventListener("DOMContentLoaded", function () {
2 | const toggleDarkMode = document.querySelector(".js-toggle-dark-mode")
3 | const cssFile = document.querySelector('[rel="stylesheet"]')
4 | const originalCssRef = cssFile.getAttribute("href")
5 | const darkModeCssRef = originalCssRef.replace(
6 | "just-the-docs.css",
7 | "dark-mode-preview.css"
8 | )
9 | const buttonCopy = ["Return to the light side", "Preview dark color scheme"]
10 | const updateButtonText = function (toggleDarkMode) {
11 | toggleDarkMode.textContent === buttonCopy[0]
12 | ? (toggleDarkMode.textContent = buttonCopy[1])
13 | : (toggleDarkMode.textContent = buttonCopy[0])
14 | }
15 |
16 | jtd.addEvent(toggleDarkMode, "click", function () {
17 | if (cssFile.getAttribute("href") === originalCssRef) {
18 | cssFile.setAttribute("href", darkModeCssRef)
19 | updateButtonText(toggleDarkMode)
20 | } else {
21 | cssFile.setAttribute("href", originalCssRef)
22 | updateButtonText(toggleDarkMode)
23 | }
24 | })
25 | })
26 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/udfeats.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: UDFeatureAnnotator
4 | keywords: udfeats
5 | permalink: '/udfeats.html'
6 | nav_order: 8
7 | parent: Full List Of Annotators
8 | ---
9 |
10 | ## Description
11 |
12 | Labels tokens with their [Universal Dependencies](http://universaldependencies.org/) universal part of speech (UPOS) and features.
13 |
14 | This is a highly specialist annotator. At the moment it only works for English. It requires a constituency parse to produce UPOS tags (but can add UD features based on dependency parses). Of our provided text output formats, the annotations this annotator produces only appear in the `conllu` format. This annotator may well disappear in a future release of CoreNLP once UD is further integrated into processing.
15 |
16 | | Property name | Annotator class name | Generated Annotation |
17 | | --- | --- | --- |
18 | | udfeats | UDFeatureAnnotator | CoNLLUFeats, CoarseTagAnnotation |
19 |
20 | ## Options
21 |
22 | At present, there are no options.
23 |
24 | ## More information
25 |
26 | See [the Universal Dependencies documentation](http://universaldependencies.org/) for more information.
27 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/relation.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: RelationExtractorAnnotator
4 | keywords: relation
5 | permalink: '/relation.html'
6 | nav_order: 6
7 | parent: Full List Of Annotators
8 | ---
9 |
10 | ## Description
11 |
12 | Stanford relation extractor is a Java implementation to find relations between two entities. The current relation extraction model is trained on the relation types (except the 'kill' relation) and data from the paper Roth and Yih, Global inference for entity and relation identification via a linear programming formulation, 2007, except instead of using the gold NER tags, we used the NER tags predicted by Stanford NER classifier to improve generalization. The default model predicts relations Live\_In, Located\_In, OrgBased\_In, Work\_For, and None.
13 |
14 | | Property name | Annotator class name | Generated Annotation |
15 | | --- | --- | --- |
16 | | relation | RelationExtractorAnnotator | MachineReadingAnnotations.RelationMentionsAnnotation |
17 |
18 | ## More information
19 |
20 | For more details of how to use and train your own model, see [this page](http://nlp.stanford.edu/software/relationExtractor.html)
21 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/repl.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Interactive mode (REPL)
4 | keywords: repl
5 | permalink: '/repl.html'
6 | nav_order: 6
7 | parent: Usage
8 | ---
9 |
10 | ## Interactive mode (REPL)
11 |
12 | ### Built-in interactive mode
13 |
14 | You can type or paste sentences or paragraphs into CoreNLP interactively and see
15 | how it analyzes them.
16 | This gives a kind of read-eval-print loop (REPL).
17 |
18 | You can use interactive mode with either `StanfordCoreNLP` or the combination
19 | of running `StanfordCoreNLPServer` and `StanfordCoreNLPClient`.
20 | You can specify whatever annotators and other properties that
21 | you want.
22 |
23 | If you do not specify any flag that directs CoreNLP
24 | to process text from a particular file, then after the pipeline
25 | is loaded, you will be placed into an interactive loop.
26 | (That is, if you don't specify either `-file` or `-filelist`.)
27 |
28 | You exit the REPL by typing:
29 | ```
30 | q RETURN
31 | ```
32 | Typing `CTRL-C` also works!
33 |
34 | ### Java 9 REPL
35 |
36 | If you are trying out the REPL for Java 9, you might want to
37 | try out using the CoreNLP [simple](simple.html) API with it.
38 | It works quite well.
39 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/sentiment.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Sentiment
4 | keywords: sentiment
5 | permalink: '/sentiment.html'
6 | nav_order: 19
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | StanfordCoreNLP includes the sentiment tool and various programs
13 | which support it. The model can be used to analyze text as part of
14 | StanfordCoreNLP by adding "sentiment" to the list of annotators.
15 | There is also command line support and model training support.
16 |
17 | SentimentAnnotator implements Socher et al's sentiment model. Attaches a binarized tree of the sentence to the sentence level CoreMap. The nodes of the tree then contain the annotations from RNNCoreAnnotations indicating the predicted class and scores for that subtree.
18 |
19 | | Property name | Annotator class name | Generated Annotation |
20 | | --- | --- | --- |
21 | | sentiment | SentimentAnnotator | entimentCoreAnnotations.AnnotatedTree |
22 |
23 | ## Options
24 |
25 | * sentiment.model: which model to load. Will default to the model included in the models jar.
26 |
27 | ## More information
28 |
29 | See the [sentiment page](http://nlp.stanford.edu/sentiment) for more information about this project.
30 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/tables.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Tables
3 | //
4 | // stylelint-disable max-nesting-depth, selector-no-type, selector-max-type
5 |
6 | .table-wrapper {
7 | display: block;
8 | width: 100%;
9 | max-width: 100%;
10 | margin-bottom: $sp-5;
11 | overflow-x: auto;
12 | border-radius: $border-radius;
13 | box-shadow: 0 1px 2px rgba(0, 0, 0, 0.12), 0 3px 10px rgba(0, 0, 0, 0.08);
14 | }
15 |
16 | table {
17 | display: table;
18 | min-width: 100%;
19 | border-collapse: separate;
20 | }
21 |
22 | th,
23 | td {
24 | @include fs-3;
25 | min-width: 120px;
26 | padding-top: $sp-2;
27 | padding-right: $sp-3;
28 | padding-bottom: $sp-2;
29 | padding-left: $sp-3;
30 | background-color: $table-background-color;
31 | border-bottom: $border rgba($border-color, 0.5);
32 | border-left: $border $border-color;
33 |
34 | &:first-of-type {
35 | border-left: 0;
36 | }
37 | }
38 |
39 | tbody {
40 | tr {
41 | &:last-of-type {
42 | th,
43 | td {
44 | border-bottom: 0;
45 | }
46 |
47 | td {
48 | padding-bottom: $sp-3;
49 | }
50 | }
51 | }
52 | }
53 |
54 | thead {
55 | th {
56 | border-bottom: $border $border-color;
57 | }
58 | }
59 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/natlog.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Natural Logic
4 | keywords: natural logic
5 | permalink: '/natlog.html'
6 | nav_order: 3
7 | parent: Full List Of Annotators
8 | ---
9 |
10 | ## Description
11 |
12 | Marks quantifier scope and token polarity, according to [natural logic](http://nlp.stanford.edu/projects/natlog.html) semantics. This is useful for many shallow logical reasoning tasks; most notably the Open IE annotator. The annotator places an `OperatorAnnotation` on tokens which are quantifiers (or other natural logic operators), and a `PolarityAnnotation` on all tokens in the sentence.
13 |
14 | For example, for the sentence "*all cats have tails*", the annotator would mark *all* as a quantifier with subject scope [1, 2) and object scope [2, 4). In addition, it would mark *cats* as a downward-polarity token, and all other tokens as upwards polarity.
15 |
16 | | Property name | Annotator class name | Generated Annotation |
17 | | --- | --- | --- |
18 | | natlog | NaturalLogicAnnotator | OperatorAnnotation, PolarityAnnotation |
19 |
20 | ## Options
21 |
22 | * natlog.dopolarity: True by default. If set to false, the annotator will only annotate quantifiers and quantifier scopes, and not annotate the polarity of each token.
23 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/custom/doc/customMenu.html:
--------------------------------------------------------------------------------
1 | {% comment %} Note that in the preview server, this code won't work because the preview sites are using different ports. These links are all relative and assume the same port. However, when you publish the built sites onto the same server, then this toggle works fine. {% endcomment %}
2 |
3 |
4 | Custom Menu
5 |
13 |
14 |
15 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/overrides.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Custom overrides from a user.
3 | //
4 |
5 | .alert {
6 | padding: 10px 15px;
7 | margin: 10px 0;
8 | border-radius: 4px;
9 | }
10 | .alert p {
11 | margin: 0;
12 | }
13 | .alert.alert-info {
14 | color: $blue-200;
15 | background: #e4efff
16 | }
17 |
18 | .toc a {
19 | white-space: normal;
20 | }
21 | td a, td a {
22 | white-space: normal !important;
23 | }
24 | td, th {
25 | min-width: 90px;
26 | }
27 |
28 | // Custom footer lists
29 | footer ul {
30 | list-style: none;
31 | height: 20px;
32 | padding: 0;
33 | }
34 |
35 | footer li {
36 | width: 40px;
37 | float: left;
38 | height: 20px;
39 | }
40 |
41 | footer li a {
42 | color: #222;
43 | text-decoration: none;
44 | }
45 |
46 | footer li a:hover {
47 | color: $link-color;
48 | }
49 |
50 | blockquote.citation {
51 | border-left: 5px $link-color solid;
52 | padding-left: 10px;
53 |
54 | a {
55 | white-space: normal;
56 | }
57 | }
58 |
59 | .code-output{
60 | &::before {
61 | @extend .text-delta;
62 | content: "Output";
63 | }
64 | }
65 |
66 | @media(max-width:800px){
67 | body {
68 | padding-bottom: 5rem;
69 | }
70 | }
71 |
72 | @media(max-width:600px){
73 | body {
74 | padding-bottom: 6rem;
75 | }
76 | }
77 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/utilities/_typography.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Utility classes for typography
3 | //
4 |
5 | // stylelint-disable primer/selector-no-utility, primer/no-override
6 |
7 | .fs-1 {
8 | @include fs-1;
9 | }
10 |
11 | .fs-2 {
12 | @include fs-2;
13 | }
14 |
15 | .fs-3 {
16 | @include fs-3;
17 | }
18 |
19 | .fs-4 {
20 | @include fs-4;
21 | }
22 |
23 | .fs-5 {
24 | @include fs-5;
25 | }
26 |
27 | .fs-6 {
28 | @include fs-6;
29 | }
30 |
31 | .fs-7 {
32 | @include fs-7;
33 | }
34 |
35 | .fs-8 {
36 | @include fs-8;
37 | }
38 |
39 | .fs-9 {
40 | @include fs-9;
41 | }
42 |
43 | .fs-10 {
44 | @include fs-10;
45 | }
46 |
47 | .fw-300 {
48 | font-weight: 300 !important;
49 | }
50 |
51 | .fw-400 {
52 | font-weight: 400 !important;
53 | }
54 |
55 | .fw-500 {
56 | font-weight: 500 !important;
57 | }
58 |
59 | .fw-700 {
60 | font-weight: 700 !important;
61 | }
62 |
63 | .lh-0 {
64 | line-height: 0 !important;
65 | }
66 |
67 | .lh-default {
68 | line-height: $body-line-height;
69 | }
70 |
71 | .lh-tight {
72 | line-height: $body-heading-line-height;
73 | }
74 |
75 | .ls-5 {
76 | letter-spacing: 0.05em !important;
77 | }
78 |
79 | .ls-10 {
80 | letter-spacing: 0.1em !important;
81 | }
82 |
83 | .ls-0 {
84 | letter-spacing: 0 !important;
85 | }
86 |
87 | .text-uppercase {
88 | text-transform: uppercase !important;
89 | }
90 |
91 | // stylelint-enable primer/selector-no-utility
92 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/extensions.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Extensions and Packages and Models by others extending CoreNLP
4 | keywords: extensions
5 | permalink: '/extensions.html'
6 | nav_order: 2
7 | toc: false
8 | parent: Additional Tools
9 | ---
10 |
11 | #### Annotators/models
12 |
13 | * [A stopword removal annotator](https://github.com/jconwell/coreNlp) by John Conwell.
14 | * English informal text\: a [GATE Twitter part-of-speech tagger](https://gate.ac.uk/wiki/twitter-postagger.html), including [a `pos.model` loadable by CoreNLP.](http://downloads.gate.ac.uk/twitie/gate-EN-twitter.model)
15 | * Swedish\: [Swedish POS tagger model](https://github.com/klintan/corenlp-swedish-pos-model) by Andreas Klintberg. See [medium post](https://medium.com/@klintcho/training-a-swedish-pos-tagger-for-stanford-corenlp-546e954a8ee7) for details.
16 | * [A fork with an Annotator for identifying multiword expressions (MWEs)](https://github.com/toliwa/CoreNLP) using jMWE by Tomasz Oliwa.
17 |
18 | We're happy to list other models and annotators that work with Stanford CoreNLP. If you have something, please get in touch!
19 |
20 | #### Models for other human languages or varieties
21 |
22 | We’ve moved this information to the page on [other human languages](human-languages.html)
23 |
24 | #### Usage in other programming languages and packages
25 |
26 | We’ve moved this information to the page on [other languages and packages](other-languages.html).
27 |
28 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/support/mixins/_typography.scss:
--------------------------------------------------------------------------------
1 | // Font size
2 |
3 | @mixin fs-1 {
4 | font-size: 9px !important;
5 |
6 | @include mq(sm) {
7 | font-size: 10px !important;
8 | }
9 | }
10 |
11 | @mixin fs-2 {
12 | font-size: 11px !important;
13 |
14 | @include mq(sm) {
15 | font-size: 12px !important;
16 | }
17 | }
18 |
19 | @mixin fs-3 {
20 | font-size: 12px !important;
21 |
22 | @include mq(sm) {
23 | font-size: 14px !important;
24 | }
25 | }
26 |
27 | @mixin fs-4 {
28 | font-size: 14px !important;
29 |
30 | @include mq(sm) {
31 | font-size: 16px !important;
32 | }
33 | }
34 |
35 | @mixin fs-5 {
36 | font-size: 16px !important;
37 |
38 | @include mq(sm) {
39 | font-size: 18px !important;
40 | }
41 | }
42 |
43 | @mixin fs-6 {
44 | font-size: 18px !important;
45 |
46 | @include mq(sm) {
47 | font-size: 24px !important;
48 | }
49 | }
50 |
51 | @mixin fs-7 {
52 | font-size: 24px !important;
53 |
54 | @include mq(sm) {
55 | font-size: 32px !important;
56 | }
57 | }
58 |
59 | @mixin fs-8 {
60 | font-size: 32px !important;
61 |
62 | @include mq(sm) {
63 | font-size: 36px !important;
64 | }
65 | }
66 |
67 | @mixin fs-9 {
68 | font-size: 36px !important;
69 |
70 | @include mq(sm) {
71 | font-size: 42px !important;
72 | }
73 | }
74 |
75 | @mixin fs-10 {
76 | font-size: 42px !important;
77 |
78 | @include mq(sm) {
79 | font-size: 48px !important;
80 | }
81 | }
82 |
--------------------------------------------------------------------------------
/Pipelined_Branch_Predict/top.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 |
3 | //Implementation Testbench for A0
4 |
5 | module top(
6 | input clk
7 | ); //Only input from the outside is clock
8 |
9 | //wire reset,rdy;
10 | wire reset;
11 | wire [31:0] iaddr, pc;
12 | wire [31:0] x31;
13 | wire man_clk;
14 | wire [31:0] L_regdata_out, EM_daddr_out, MW_drdata_out;
15 | //Input-output ports controlled by VIO and ILA
16 |
17 | wire [35:0] ILA_CONTROL, VIO_CONTROL;
18 | //Control wires used by ICON to control VIO and ILA
19 |
20 |
21 | pipeline_CPU instanceA (man_clk, reset, iaddr, x31, L_regdata_out, EM_daddr_out, MW_drdata_out);
22 |
23 | //Calling the multiplier instance
24 |
25 |
26 | //Calls for ICON, VIO and ILA blocks
27 | icon0 instanceB (
28 | .CONTROL0(ILA_CONTROL), // INOUT BUS [35:0]
29 | .CONTROL1(VIO_CONTROL) // INOUT BUS [35:0]
30 | );
31 |
32 | vio0 instanceC (
33 | .CONTROL(VIO_CONTROL), // INOUT BUS [35:0]
34 | //.CLK(clka), // IN
35 | .ASYNC_OUT({man_clk, reset}), // OUT BUS [1:0]
36 | .ASYNC_IN({iaddr, x31, L_regdata_out, EM_daddr_out, MW_drdata_out}) // IN BUS [159:0]
37 | );
38 |
39 | ila0 instanceD (
40 | .CONTROL(ILA_CONTROL), // INOUT BUS [35:0]
41 | .CLK(clka), // IN
42 | .TRIG0(iaddr), // IN BUS [31:0]
43 | .TRIG1(x31) // add other o/ps
44 | //.TRIG2(out) // IN BUS [15:0]
45 | );
46 |
47 | endmodule
48 |
49 | /*
50 | UCF statement to be added in constraints file-
51 | NET "clk" LOC = "C9" | IOSTANDARD = LVCMOS33 ;
52 | */
53 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/head_print.html:
--------------------------------------------------------------------------------
1 |
2 |
3 |
4 |
5 |
6 | {% if page.homepage == true %} {{site.homepage_title}} {% elsif page.title %}{{ page.title }}{% endif %} | {{ site.site_title }}
7 |
8 |
9 |
10 |
11 |
12 |
13 |
14 |
15 |
20 |
21 |
26 |
27 |
28 |
29 |
30 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/utilities/_layout.scss:
--------------------------------------------------------------------------------
1 | // stylelint-disable primer/selector-no-utility, primer/no-override
2 | //
3 | // Utility classes for layout
4 | //
5 |
6 | // Display
7 |
8 | .d-block {
9 | display: block !important;
10 | }
11 | .d-flex {
12 | display: flex !important;
13 | }
14 | .d-inline {
15 | display: inline !important;
16 | }
17 | .d-inline-block {
18 | display: inline-block !important;
19 | }
20 | .d-none {
21 | display: none !important;
22 | }
23 |
24 | @each $media-query in map-keys($media-queries) {
25 | @for $i from 1 through length($spacers) {
26 | @include mq($media-query) {
27 | $size: #{map-get($spacers, sp-#{$i - 1})};
28 | $scale: #{$i - 1};
29 |
30 | // .d-sm-block, .d-md-none, .d-lg-inline
31 | .d-#{$media-query}-block {
32 | display: block !important;
33 | }
34 | .d-#{$media-query}-flex {
35 | display: flex !important;
36 | }
37 | .d-#{$media-query}-inline {
38 | display: inline !important;
39 | }
40 | .d-#{$media-query}-inline-block {
41 | display: inline-block !important;
42 | }
43 | .d-#{$media-query}-none {
44 | display: none !important;
45 | }
46 | }
47 | }
48 | }
49 |
50 | // Vertical alignment
51 |
52 | .v-align-baseline {
53 | vertical-align: baseline !important;
54 | }
55 | .v-align-bottom {
56 | vertical-align: bottom !important;
57 | }
58 | .v-align-middle {
59 | vertical-align: middle !important;
60 | }
61 | .v-align-text-bottom {
62 | vertical-align: text-bottom !important;
63 | }
64 | .v-align-text-top {
65 | vertical-align: text-top !important;
66 | }
67 | .v-align-top {
68 | vertical-align: top !important;
69 | }
70 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/entitylink.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Entity Linking
4 | keywords: entity linking, entity link, WikidictAnnotator
5 | permalink: '/entitylink.html'
6 | nav_order: 17
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Uses a dictionary to match entity mention text to a specific entity in Wikipedia.
13 |
14 | For instance the text `Hank Williams` is matched to [Hank Williams](https://en.wikipedia.org/wiki/Hank_Williams).
15 |
16 | A useful example of this would be that both the strings `FDR` and `Franklin Delano Roosevelt` are mapped to
17 | the [Franklin D. Roosevelt](https://en.wikipedia.org/wiki/Franklin_D._Roosevelt) page.
18 |
19 | The English WikiDict contains 20948089 mappings from Strings to entities.
20 |
21 | | Property name | Annotator class name | Generated Annotation |
22 | | --- | --- | --- |
23 | | entitylink | WikidictAnnotator | WikipediaEntityAnnotation |
24 |
25 | ## Example Usage
26 |
27 | ### Command Line
28 |
29 | ```
30 | java -Xmx16g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos,lemma,ner,entitylink -file example.txt
31 | ```
32 |
33 | ## Options
34 |
35 | | Option name | Type | Description | Default |
36 | | --- | --- | ----- | --- |
37 | | entitylink.wikidict | file, classpath, or URL | Path of wikidict to use. | .../models/kbp/english/wikidict.tab.gz |
38 | | entitylink.caseless | boolean | Ignore case when matching (e.g. `barack obama` and `Barack Obama` will map to the same thing. | false |
39 |
40 | * There are currently dictionaries for `Chinese, English, Spanish`.
41 |
42 | ## More information
43 |
44 | The dictionary construction process is described in more detail in the paper [A Cross-Lingual Dictionary for English Wikipedia Concepts](https://nlp.stanford.edu/pubs/crosswikis.pdf)
45 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/docdate.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Document Date
4 | keywords: docdate
5 | permalink: '/docdate.html'
6 | nav_order: 1
7 | parent: Full List Of Annotators
8 | ---
9 |
10 | ## Description
11 |
12 | Provides several methods for setting the date of documents. One can use the standalone `docdate` annotator
13 | or use the sub-annotator `ner.docdate` that is contained by the `ner` annotator. If using the sub-annotator
14 | in `ner` do not also use the standalone annotator.
15 |
16 | | Property name | Annotator class name | Generated Annotation |
17 | | --- | --- | --- |
18 | | docdate | DocDateAnnotator | DocDateAnnotation |
19 |
20 | ## Example Usage
21 |
22 | ### Command Line
23 |
24 | ```
25 | # as a standalone annotator
26 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP edu.stanford.nlp.pipeline.DocDateAnnotator -annotators tokenize,ssplit,docdate -docdate.useFixedDate 2019-01-01 -file example.txt
27 | ```
28 |
29 | ```
30 | # as a sub-annotator of ner
31 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos,lemma,ner -ner.docdate.useFixedDate 2019-01-01 -file example.txt
32 | ```
33 |
34 | ## Options
35 |
36 | | Option name | Type | Default | Description |
37 | | --- | --- | --- | --- |
38 | | docdate.useFixedDate | String | - | Set every document to have a fixed date (e.g. 2019-01-01) |
39 | | docdate.useMappingFile | file, classpath, or URL | - | Use a tab-delimited file to specify doc dates. First column is document ID, second column is date. |
40 | | docdate.usePresent | - | - | Set every document to have the present date as the date. |
41 | | docdate.useRegex | String | - | Specify a regular expression matching file names. The first group will be extracted as the date. (e.g. NYT-([0-9]{4}-[0-9]{2}-[0-9]{2}).xml ) |
42 |
43 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/contact.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Contact
4 | keywords: contact
5 | permalink: '/contact.html'
6 | nav_order: 7
7 | toc: false
8 | parent: Resources
9 | ---
10 |
11 | ## Questions
12 |
13 | Have a support question? Please ask us on [Stack Overflow](http://stackoverflow.com/) using the tag `stanford-nlp`.
14 |
15 | ## Mailing lists
16 |
17 | We have 3 mailing lists for Stanford CoreNLP, all of which are shared with other JavaNLP tools (with the exclusion of the parser). Each address is at `@lists.stanford.edu`:
18 |
19 | 1. `java-nlp-user` This is the best list to post to in order to send feature requests, make announcements, or for discussion among JavaNLP users. (Please ask support questions on [Stack Overflow](http://stackoverflow.com/) using the `stanford-nlp` tag.)
20 | You have to subscribe to be able to use this list. Join the list via [this webpage]() or by emailing `java-nlp-user-join@lists.stanford.edu`. (Leave the subject and message body empty.) You can also look at the [list archives](https://mailman.stanford.edu/pipermail/java-nlp-user/).
21 |
22 | 2. `java-nlp-announce` This list will be used only to announce new versions of Stanford JavaNLP tools. So it will be very low volume (expect 2-4 messages a year). Join the list via [this webpage](https://mailman.stanford.edu/mailman/listinfo/java-nlp-announce) or by emailing `java-nlp-announce-join@lists.stanford.edu`. (Leave the subject and message body empty.)
23 |
24 | 3. `java-nlp-support` This list goes only to the software maintainers. It's a good address for licensing questions, etc. **For general use and support questions, you're better off using Stack Overflow or joining and using `java-nlp-user`**. You cannot join `java-nlp-support`, but you can mail questions to `java-nlp-support@lists.stanford.edu`.
25 |
26 |
27 |
28 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/entitymentions.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Entity Mentions
4 | keywords: entity mentions
5 | permalink: '/entitymentions.html'
6 | nav_order: 2
7 | parent: Full List Of Annotators
8 | ---
9 |
10 | ## Description
11 |
12 | This annotator generates a list of the mentions, identified by NER, found in each sentence of a document. Rather than per-token labeling, it produces whole entity mentions. For example, "New York City" will be identified as one entity mention. The "sentences" element of a document annotation will additionally contain an "entitymentions" element. The value of this is a list of individual entity mentions, including their text, their span in tokens and character offsets, their NER tag, and for quantities, their normalized value, and TIMEX form, as appropriate. This detail is available to API users. At present, entity mentions are only included in the output of the JSON outputter.
13 |
14 | | Property name | Annotator class name | Generated Annotation |
15 | | --- | --- | --- |
16 | | entitymentions | EntityMentionsAnnotator | MentionsAnnotation |
17 |
18 | ## Options
19 |
20 | | Option name | Type | Default | Description |
21 | | --- | --- | --- | --- |
22 | | entitymentions.nerCoreAnnotation | class | CoreAnnotations.NamedEntityTagAnnotation.class | Class to use as key to look up NER value. |
23 | | entitymentions.nerNormalizedCoreAnnotation | class | CoreAnnotations.NormalizedNamedEntityTagAnnotation.class | Class to use as key to look up normalized named entity value. |
24 | | entitymentions.mentionsCoreAnnotation | class | CoreAnnotations.MentionsAnnotation.class | Class to use as key to look up mentions. |
25 | | entitymentions.acronyms | boolean | false | If true, heuristically search for organization acronyms, even if they are not marked explicitly by an NER tag. That is, it looks for putative acronyms of an organization identified elsewhere in the document. In some work this has been super useful (+20% recall). |
26 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/DF-sample.xml:
--------------------------------------------------------------------------------
1 |
2 |
3 | Worth looking in to?
4 |
5 |
6 | Yesterday afternoon as I negotiated route 149 from Lake George to Fort Ann in NY I passed a new diner that had opened that day. I didnt notice the name but out side it had a Union Jack and a St Georges flag flying
7 | I wonder if they serve proper 'English' food, served by proper 'English' people ? I may have to check it out asap 
8 |
9 |
10 | 
15 |
16 |
17 |
23 |
24 |
29 |
30 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/lemma.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Lemmatization
4 | keywords: lemma, MorphaAnnotator
5 | permalink: '/lemma.html'
6 | nav_order: 10
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Lemmatization maps a word to its lemma (dictionary form). For instance, the word `was` is mapped to the word `be`.
13 |
14 | | Name | Annotator class name | Requirement | Generated Annotation | Description |
15 | | --- | --- | --- | --- | --- |
16 | | lemma | MorphaAnnotator | TokensAnnotation, SentencesAnnotation, PartOfSpeechAnnotation | LemmaAnnotation | Determine lemmas for each token. |
17 |
18 |
19 | ## Lemmatization From The Command Line
20 |
21 | This command will find lemmas for the input text:
22 |
23 | ```bash
24 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos,lemma -file input.txt
25 | ```
26 |
27 | Other output formats include `conllu`, `conll`, `json`, and `serialized`.
28 |
29 | ## Lemmatization From Java
30 |
31 | ```
32 | package edu.stanford.nlp.examples;
33 |
34 | import edu.stanford.nlp.ling.*;
35 | import edu.stanford.nlp.pipeline.*;
36 |
37 | import java.util.*;
38 |
39 |
40 | public class LemmatizingExample {
41 |
42 | public static String text = "Marie was born in Paris.";
43 |
44 | public static void main(String[] args) {
45 | // set up pipeline properties
46 | Properties props = new Properties();
47 | // set the list of annotators to run
48 | props.setProperty("annotators", "tokenize,ssplit,pos,lemma");
49 | // build pipeline
50 | StanfordCoreNLP pipeline = new StanfordCoreNLP(props);
51 | // create a document object
52 | CoreDocument document = pipeline.processToCoreDocument(text);
53 | // display tokens
54 | for (CoreLabel tok : document.tokens()) {
55 | System.out.println(String.format("%s\t%s", tok.word(), tok.lemma()));
56 | }
57 | }
58 |
59 | }
60 | ```
61 |
62 | This demo code will print out the lemmas for each token:
63 |
64 | ```
65 | Marie Marie
66 | was be
67 | born bear
68 | in in
69 | Paris Paris
70 | . .
71 | ```
72 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/base.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Base element style overrides
3 | //
4 | // stylelint-disable selector-no-type, selector-max-type
5 |
6 | * {
7 | box-sizing: border-box;
8 | }
9 |
10 | ::selection {
11 | color: $white;
12 | background: $link-color;
13 | }
14 |
15 | html {
16 | @include fs-4;
17 | }
18 |
19 | body {
20 | font-family: $body-font-family;
21 | font-size: inherit;
22 | line-height: $body-line-height;
23 | color: $body-text-color;
24 | background-color: $body-background-color;
25 | }
26 |
27 | p,
28 | h1,
29 | h2,
30 | h3,
31 | h4,
32 | h5,
33 | h6,
34 | ol,
35 | ul,
36 | pre,
37 | address,
38 | blockquote,
39 | dl,
40 | div,
41 | fieldset,
42 | form,
43 | hr,
44 | noscript,
45 | table {
46 | margin-top: 0;
47 | }
48 |
49 | h1,
50 | h2,
51 | h3,
52 | h4,
53 | h5,
54 | h6 {
55 | margin-top: 1.2em;
56 | margin-bottom: 0.8em;
57 | font-weight: 500;
58 | line-height: $body-heading-line-height;
59 | color: $body-heading-color;
60 | }
61 |
62 | p {
63 | margin-bottom: 1em;
64 | }
65 |
66 | a {
67 | color: $link-color;
68 | text-decoration: none;
69 | }
70 |
71 | a:not([class]) {
72 | text-decoration: none;
73 | background-image: linear-gradient($border-color 0%, $border-color 100%);
74 | background-repeat: repeat-x;
75 | background-position: 0 100%;
76 | background-size: 1px 1px;
77 |
78 | &:hover {
79 | background-image: linear-gradient(
80 | rgba($link-color, 0.45) 0%,
81 | rgba($link-color, 0.45) 100%
82 | );
83 | background-size: 1px 1px;
84 | }
85 | }
86 |
87 | code {
88 | font-family: $mono-font-family;
89 | font-size: 12px;
90 | line-height: $body-line-height;
91 | }
92 |
93 | figure,
94 | pre {
95 | margin: 0;
96 | }
97 |
98 | li {
99 | margin: 0.25em 0;
100 | }
101 |
102 | img {
103 | max-width: 100%;
104 | height: auto;
105 | }
106 |
107 | hr {
108 | height: 1px;
109 | padding: 0;
110 | margin: $sp-6 0;
111 | background-color: $border-color;
112 | border: 0;
113 | }
114 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/custom/doc/doc_homepage.md:
--------------------------------------------------------------------------------
1 | {% include linkrefs.html %}
2 |
3 | ## Overview
4 |
5 | This site provides documentation, training, and other notes for the Jekyll Documentation theme. There's a lot of information about how to do a variety of things here, and it's not all unique to this theme. But by and large, understanding how to do things in Jekyll depends on how your theme is coded.
6 |
7 | ## Survey of features
8 |
9 | Some of the more prominent features of this theme include the following:
10 |
11 | * Bootstrap framework
12 | * Sidebar with page hierarchy
13 | * PDF generation (with Prince XML utility)
14 | * Notes, tips, and warning information notes
15 | * Tags
16 | * Single sourced outputs
17 | * Emphasis on pages, not posts
18 | * Relative (rather than absolute) link structure
19 |
20 | I'm using this theme for my documentation projects, building about 15 different outputs for various products, versions, languages, and audiences from the same set of files. This single sourcing requirement has influenced how I constructed this theme.
21 |
22 | For more discussion about the available features, see {{doc_supported_features}}.
23 |
24 | ## Getting started
25 |
26 | To get started, see these three topics:
27 |
28 | 1. {{doc_getting_started}}
29 | 2. {{doc_configuration_settings}}
30 | 3. {{doc_customizing_the_theme}}
31 |
32 | ## PDF Download
33 |
34 | If you would like to download this help file as a PDF, you can do so here. The PDF most of the same content as the online help, except that some elements (such as video or special layouts) don't translate the the print medium, so they're excluded.
35 |
36 |
37 |
38 | The PDF contains a timestamp in the header indicating when it was last generated. If you download a PDF, keep in mind that it may go out of date quickly. Always compare your PDF timestamp against the online help timestamp (which you can find in the footer).
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/tutorials.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Tutorials
4 | keywords: tutorials
5 | permalink: '/tutorials.html'
6 | nav_order: 3
7 | toc: false
8 | parent: Resources
9 | ---
10 |
11 | We don't have a ton of tutorial information on CoreNLP on this site. Sorry! We'll try to improve that over time.
12 |
13 | However, here are some tutorials by third parties. Note that some of this tutorial material ages with the release of newer versions of CoreNLP, and it may not be fully up to date with current CoreNLP. Check the date/version of it.
14 |
15 | ### Getting started with CoreNLP
16 |
17 | * [linguisticsweb.org tutorial](http://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:linguistics_tutorials:automaticannotation:stanford_core_nlp)
18 | * [Stanford CoreNLP Tutorial](https://interviewbubble.com/stanford-corenlp-tutorial/)
19 | * [Natural Language Processing with Stanford CoreNLP](https://cloudacademy.com/blog/natural-language-processing-stanford-corenlp-2/) from the CloudAcademy Blog. Has comparisons with Google Cloud NL API.
20 |
21 | ### NER
22 |
23 | * [Recognizing Named Entities - An Introduction](http://blog.thehumangeo.com/ner-intro.html) by Denny DeCastro and Kyle von Bredow at HumanGeo. Also another blog post on [Named Entity Recognition for Twitter](http://blog.thehumangeo.com/twitter-ner.html) by George Cooper.
24 |
25 | ### Sentiment analysis
26 |
27 | * [Red Hat OpenShift Day 20: Stanford CoreNLP – Performing Sentiment Analysis of Twitter using Java](https://blog.openshift.com/day-20-stanford-corenlp-performing-sentiment-analysis-of-twitter-using-java/) by Shekhar Gulati.
28 |
29 | ### Python
30 |
31 | * [How to setup and use Stanford CoreNLP Server with Python](https://www.khalidalnajjar.com/setup-use-stanford-corenlp-server-python/)
32 |
33 | ### Japanese
34 |
35 | * [CoreNLP を使ってみる(1)/Try using CoreNLP (1)](http://lab.astamuse.co.jp/entry/corenlp1): A tutorial introduction to CoreNLP in Japanese by astamuse Lab.
36 |
37 | ### Slides
38 |
39 | * [Stanford CoreNLP Introduction](http://www.sfs.uni-tuebingen.de/~keberle/NLPTools/presentations/CoreNLP/CoreNLP_introduction.pdf) by Svea Klaus.
40 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/vendor/normalize.scss/package.json:
--------------------------------------------------------------------------------
1 | {
2 | "_args": [
3 | [
4 | "normalize.scss",
5 | "/Users/pmarsceill/_projects/just-the-docs"
6 | ]
7 | ],
8 | "_from": "normalize.scss@*",
9 | "_id": "normalize.scss@0.1.0",
10 | "_inCache": true,
11 | "_installable": true,
12 | "_location": "/normalize.scss",
13 | "_nodeVersion": "0.10.32",
14 | "_npmUser": {
15 | "email": "alexguerrero1092@gmail.com",
16 | "name": "alexguerrero"
17 | },
18 | "_npmVersion": "2.0.2",
19 | "_phantomChildren": {},
20 | "_requested": {
21 | "name": "normalize.scss",
22 | "raw": "normalize.scss",
23 | "rawSpec": "",
24 | "scope": null,
25 | "spec": "*",
26 | "type": "range"
27 | },
28 | "_requiredBy": [
29 | "#DEV:/"
30 | ],
31 | "_resolved": "https://registry.npmjs.org/normalize.scss/-/normalize.scss-0.1.0.tgz",
32 | "_shasum": "4a21dc25bd4c019c857785f829b658aba2a8f9ab",
33 | "_shrinkwrap": null,
34 | "_spec": "normalize.scss",
35 | "_where": "/Users/pmarsceill/_projects/just-the-docs",
36 | "author": "",
37 | "bugs": {
38 | "url": "https://github.com/guerrero/normalize.scss/issues"
39 | },
40 | "dependencies": {},
41 | "description": "Normalize.scss as a node packaged module",
42 | "devDependencies": {},
43 | "directories": {},
44 | "dist": {
45 | "shasum": "4a21dc25bd4c019c857785f829b658aba2a8f9ab",
46 | "tarball": "https://registry.npmjs.org/normalize.scss/-/normalize.scss-0.1.0.tgz"
47 | },
48 | "files": [
49 | "normalize.scss"
50 | ],
51 | "gitHead": "d67d517e28615a873066438af1d4845c157c9baf",
52 | "homepage": "https://github.com/guerrero/normalize.scss",
53 | "license": "MIT",
54 | "maintainers": [
55 | {
56 | "name": "alexguerrero",
57 | "email": "alexguerrero1092@gmail.com"
58 | }
59 | ],
60 | "name": "normalize.scss",
61 | "optionalDependencies": {},
62 | "readme": "ERROR: No README data found!",
63 | "repository": {
64 | "type": "git",
65 | "url": "git://github.com/guerrero/normalize.scss.git"
66 | },
67 | "scripts": {},
68 | "style": "normalize.scss",
69 | "version": "0.1.0"
70 | }
71 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/navigation.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Main nav, breadcrumb, etc...
3 | //
4 | .navigation-list {
5 | padding: 0;
6 | margin-top: 0;
7 | margin-bottom: 0;
8 | list-style: none;
9 | }
10 |
11 | .navigation-list-child-list {
12 | padding-left: $sp-3;
13 | list-style: none;
14 |
15 | .navigation-list-link {
16 | color: $nav-child-link-color;
17 | }
18 |
19 | .navigation-list-item {
20 | position: relative;
21 |
22 | &::before {
23 | position: absolute;
24 | margin-top: 0.3em;
25 | margin-left: -0.8em;
26 | color: rgba($body-text-color, 0.3);
27 | content: "- ";
28 | }
29 |
30 | &.active {
31 | &::before {
32 | color: $body-text-color;
33 | }
34 | }
35 | }
36 | }
37 |
38 | .navigation-list-item {
39 | @include fs-4;
40 | margin: 0;
41 |
42 | @include mq(md) {
43 | @include fs-3;
44 | }
45 |
46 | .navigation-list-child-list {
47 | display: none;
48 | }
49 |
50 | &.active {
51 | .navigation-list-child-list {
52 | display: block;
53 | }
54 | }
55 | }
56 |
57 | .navigation-list-link {
58 | display: block;
59 | padding-top: $sp-1;
60 | padding-bottom: $sp-1;
61 |
62 | &.active {
63 | font-weight: 600;
64 | color: $body-heading-color;
65 | text-decoration: none;
66 | }
67 | }
68 |
69 | // Small screen nav
70 |
71 | .main-nav {
72 | display: none;
73 |
74 | &.nav-open {
75 | display: block;
76 | }
77 | @include mq(md) {
78 | display: block;
79 | }
80 | }
81 |
82 | .aux-nav {
83 | align-self: center;
84 | }
85 |
86 | // Breadcrumb nav
87 | .breadcrumb-nav {
88 | @include mq(md) {
89 | margin-top: -$sp-4;
90 | }
91 | }
92 |
93 | .breadcrumb-nav-list {
94 | padding-left: 0;
95 | margin-bottom: $sp-3;
96 | list-style: none;
97 | }
98 |
99 | .breadcrumb-nav-list-item {
100 | display: table-cell;
101 | @include fs-2;
102 |
103 | &::before {
104 | display: none;
105 | }
106 |
107 | &::after {
108 | display: inline-block;
109 | margin-right: $sp-2;
110 | margin-left: $sp-2;
111 | color: $grey-dk-000;
112 | content: "/";
113 | }
114 |
115 | &:last-child {
116 | &::after {
117 | content: "";
118 | }
119 | }
120 | }
121 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/model-zoo.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Model Zoo
4 | keywords: model zoo
5 | permalink: '/model-zoo.html'
6 | nav_order: 1
7 | toc: false
8 | parent: Resources
9 | ---
10 |
11 | A variety of third-party groups have created extensions for Stanford CoreNLP.
12 |
13 | In the table below we provide access to their work. By simply adding the jar for
14 | an entry to your classpath, you can begin using the extension.
15 |
16 | For example, if you download `corenlp-swedish-1.0.0.jar` and place it in your
17 | CLASSPATH, you can then run a POS tagger on Swedish.
18 |
19 | ```bash
20 | # set up CLASSPATH to include model zoo jars
21 | export CLASSPATH=$CLASSPATH:/path/to/model_zoo/*
22 | # go to model zoo directory
23 | cd /path/to/model_zoo
24 | # download file
25 | wget https://nlp.stanford.edu/software/model_zoo/corenlp-swedish-1.0.0.jar
26 | # run swedish pos tagger
27 | java -Xmx2g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos -pos.model edu/stanford/nlp/models/zoo/corenlp-swedish/swedish.tagger -file example-swedish-sentence.txt -outputFormat text
28 | ```
29 |
30 | If you would like to contribute to the Model Zoo,
31 | contact us
32 | or issue a pull request on our
33 | GitHub!
34 |
35 | | Name | Language | Description | Group | Version | Requires | Download |
36 | | --- | --- | --- | --- | --- | --- | --- |
37 | | Russian CoreNLP | Russian | POS and Parsing for Russian. More info [here](https://github.com/MANASLU8/CoreNLP) | ITMO University | 1.0.0 | latest code on GitHub | [stanford-russian-corenlp-models.jar](https://drive.google.com/file/d/1_0oU8BOiYCqHvItSsz0BjJnSNp8PRWlC/view?usp=sharing) |
38 | | Swedish CoreNLP | Swedish | A POS model for Swedish. More info [here](https://medium.com/@klintcho/training-a-swedish-pos-tagger-for-stanford-corenlp-546e954a8ee7) | Andreas Klintberg | 1.0.0 | Stanford CoreNLP 3.9.2 | [corenlp-swedish-1.0.0.jar](https://nlp.stanford.edu/software/model_zoo/corenlp-swedish-1.0.0.jar) |
39 | | Danish CoreNLP | Danish | An NER model for Danish. More info [here](https://arxiv.org/abs/1906.11608) | [ITU Copenhagen](http://nlp.itu.dk/) | 1.0.0 | Stanford CoreNLP 3.9.2 | [da01.model.gz](https://github.com/ITUnlp/daner/blob/master/da01.model.gz) |
40 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_data/sidebar_doc.yml:
--------------------------------------------------------------------------------
1 | # This is your sidebar TOC. The sidebar code loops through sections here and provides the appropriate formatting.
2 |
3 | # Sidebar
4 | entries:
5 | - title: Sidebar
6 | subcategories:
7 |
8 | - title: Overview
9 |
10 | items:
11 | - title: About
12 | url: index.html#about
13 |
14 | - title: Get Started
15 | url: index.html#get-started
16 |
17 | - title: License and Citing
18 | url: index.html#license
19 |
20 | - title: Usage
21 |
22 | items:
23 |
24 | - title: Installation & Getting Started
25 | url: installation_usage.html
26 |
27 | - title: Tutorials
28 | url: tutorials.html
29 |
30 | - title: Available Models
31 | url: models.html
32 |
33 | - title: System Performance
34 | url: performance.html
35 |
36 | - title: Model Training and Evaluation
37 | url: training.html
38 |
39 | - title : Pipeline
40 |
41 | items:
42 | - title: Pipeline
43 | url: pipeline.html
44 |
45 | - title: Tokenization
46 | url: tokenize.html
47 |
48 | - title: Sentence Splitting
49 | url: ssplit.html
50 |
51 | - title: Multi Word Tokenization
52 | url: mwt.html
53 |
54 | - title: Parts Of Speech
55 | url: pos.html
56 |
57 | - title: Lemmatization
58 | url: lemma.html
59 |
60 | - title: Named Entity Recognition
61 | url: ner.html
62 |
63 | - title: Dependency Parsing
64 | url: depparse.html
65 |
66 | - title: Constituency Parsing
67 | url: parse.html
68 |
69 |
70 | - title: Server
71 |
72 | items:
73 | - title: Overview
74 | url: corenlp_client.html#overview
75 |
76 | - title: Setup
77 | url: corenlp_client.html#setup
78 |
79 | - title: Usage
80 | url: corenlp_client.html#usage
81 |
82 | - title: Customization
83 | url: corenlp_client.html#customizing-properties-for-server-start-and-requests
84 |
85 | - title: Resources
86 |
87 | items:
88 | - title: FAQ
89 | url: faq.html
90 |
91 | - title: Release History
92 | url: release_history.html
93 |
94 | - title: Model History
95 | url: model_history.html
96 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/nav.html:
--------------------------------------------------------------------------------
1 |
41 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/new_annotator.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Custom Annotators
4 | keywords: custom annotators
5 | permalink: '/new_annotator.html'
6 | nav_order: 5
7 | parent: Pipeline
8 | ---
9 |
10 | Users can add custom annotators to StanfordCoreNLP.
11 |
12 | First write the custom annotator class. Here is an example which
13 | will take in a dictionary that maps words to lemmas:
14 |
15 | ```java
16 | package edu.stanford.nlp.examples;
17 |
18 | import edu.stanford.nlp.ling.*;
19 | import edu.stanford.nlp.pipeline.*;
20 | import edu.stanford.nlp.io.*;
21 | import edu.stanford.nlp.util.ArraySet;
22 |
23 | import java.util.*;
24 |
25 |
26 | public class CustomLemmaAnnotator implements Annotator {
27 |
28 | HashMap wordToLemma = new HashMap();
29 |
30 | public CustomLemmaAnnotator(String name, Properties props) {
31 | // load the lemma file
32 | // format should be tsv with word and lemma
33 | String lemmaFile = props.getProperty("custom.lemma.lemmaFile");
34 | List lemmaEntries = IOUtils.linesFromFile(lemmaFile);
35 | for (String lemmaEntry : lemmaEntries) {
36 | wordToLemma.put(lemmaEntry.split("\\t")[0], lemmaEntry.split("\\t")[1]);
37 | }
38 | }
39 |
40 | public void annotate(Annotation annotation) {
41 | for (CoreLabel token : annotation.get(CoreAnnotations.TokensAnnotation.class)) {
42 | String lemma = wordToLemma.getOrDefault(token.word(), token.word());
43 | token.set(CoreAnnotations.LemmaAnnotation.class, lemma);
44 | }
45 | }
46 |
47 | @Override
48 | public Set> requires() {
49 | return Collections.unmodifiableSet(new ArraySet<>(Arrays.asList(
50 | CoreAnnotations.TextAnnotation.class,
51 | CoreAnnotations.TokensAnnotation.class,
52 | CoreAnnotations.SentencesAnnotation.class,
53 | CoreAnnotations.PartOfSpeechAnnotation.class
54 | )));
55 | }
56 |
57 | @Override
58 | public Set> requirementsSatisfied() {
59 | return Collections.singleton(CoreAnnotations.LemmaAnnotation.class);
60 | }
61 |
62 | }
63 | ```
64 |
65 | Then produce a properties file which allows Stanford CoreNLP to use
66 | your custom annotator:
67 |
68 | ```bash
69 | customAnnotatorClass.custom.lemma = edu.stanford.nlp.examples.CustomLemmaAnnotator
70 |
71 | annotators = tokenize,ssplit,pos,custom.lemma
72 |
73 | custom.lemma.lemmaFile = custom-lemmas.txt
74 | ```
75 |
76 | Finally you can run this example with this command:
77 |
78 | ```bash
79 | java -Xmx2g edu.stanford.nlp.pipeline.StanfordCoreNLP -props custom-lemmas-example.properties -file example.txt -outputFormat text
80 | ```
81 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_config.yml:
--------------------------------------------------------------------------------
1 | # Welcome to Jekyll!
2 | #
3 | # This config file is meant for settings that affect your whole site, values
4 | # which you are expected to set up once and rarely edit after that. If you find
5 | # yourself editing these this file very often, consider using Jekyll's data files
6 | # feature for the data you need to update frequently.
7 | #
8 | # For technical reasons, this file is *NOT* reloaded automatically when you use
9 | # 'jekyll serve'. If you change this file, please restart the server process.
10 |
11 | # Site settings
12 | # These are used to personalize your new site. If you look in the HTML files,
13 | # you will see them accessed via {{ site.title }}, {{ site.github_repo }}, and so on.
14 | # You can create any custom variable you would like, and they will be accessible
15 | # in the templates via {{ site.myvariable }}.
16 | title: CoreNLP
17 | description: NLP Processing In Java
18 | url: https://stanfordnlp.github.io
19 |
20 | permalink: pretty
21 | exclude: ["node_modules/", "*.gemspec", "*.gem", "Gemfile", "Gemfile.lock", "package.json", "package-lock.json", "script/", "LICENSE.txt", "lib/", "bin/", "README.md", "Rakefile", "configs/", "_site", "di_multi*"]
22 |
23 | include:
24 | - _pages
25 |
26 | # Set a path/url to a logo that will be displayed instead of the title
27 | logo: assets/images/corenlp-logo.png
28 |
29 | # Enable or disable the site search
30 | search_enabled: true
31 |
32 | # Set the search token separator for hyphenated-word search:
33 | search_tokenizer_separator: /[\s/]+/
34 |
35 | # Enable or disable heading anchors
36 | heading_anchors: true
37 |
38 | # Aux links for the upper right navigation
39 | #aux_links:
40 | # "
"
41 | # - "//pypi.org/project/stanza/"
42 | # "
"
43 | # - "//anaconda.org/stanfordnlp/stanza"
44 | # "
"
45 | # - "//pypi.org/project/stanza/"
46 |
47 | # Footer content appears at the bottom of every page's main content
48 | footer_content: "Copyright © 2020 Stanford NLP Group."
49 |
50 | # Color scheme currently only supports "dark" or nil (default)
51 | color_scheme: nil
52 |
53 | # Google Analytics Tracking (optional)
54 | # e.g, UA-1234567-89
55 | ga_tracking: UA-133356038-1
56 |
57 | plugins:
58 | - jekyll-seo-tag
59 | - jekyll-relative-links
60 |
61 | compress_html:
62 | clippings: all
63 | comments: all
64 | endings: all
65 | startings: []
66 | blanklines: false
67 | profile: false
68 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/depparse.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Dependency Parsing
4 | keywords: depparse, DependencyParseAnnotator, dependency parsing
5 | permalink: '/depparse.html'
6 | nav_order: 12
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Provides a fast syntactic dependency parser. We generate three dependency-based outputs, as follows: basic, uncollapsed dependencies, saved in BasicDependenciesAnnotation; enhanced dependencies saved in EnhancedDependenciesAnnotation; and enhanced++ dependencies in EnhancedPlusPlusDependenciesAnnotation. Most users of our parser will prefer the latter representation.
13 |
14 | This is a separate annotator for a direct dependency parser. These
15 | parsers require prior part-of-speech tagging. If you need constituency
16 | parses then you should look at the `parse` annotator.
17 |
18 | | Property name | Annotator class name | Generated Annotation |
19 | | --- | --- | --- |
20 | | depparse | DependencyParseAnnotator | BasicDependenciesAnnotation, EnhancedDependenciesAnnotation, EnhancedPlusPlusDependenciesAnnotation |
21 |
22 | ## Options
23 |
24 | | Option name | Type | Default | Description |
25 | | --- | --- | --- | --- |
26 | | depparse.model | file, classpath, or URL | edu/stanford/nlp/models/parser/nndep/english\_UD.gz | Dependency parsing model to use. There is no need to explicitly set this option, unless you want to use a different parsing model than the default. By default, this is set to the UD parsing model included in the stanford-corenlp-models JAR file. |
27 |
28 |
29 | ## Training a model
30 |
31 | Here is an example command for training your own model. In this example we will train a French dependency parser.
32 |
33 | ```bash
34 | java -Xmx12g edu.stanford.nlp.parser.nndep.DependencyParser -trainFile fr-ud-train.conllu -devFile fr-ud-dev.conllu -model new-french-UD-model.txt.gz -embedFile wiki.fr.vec -embeddingSize 300 -tlp edu.stanford.nlp.trees.international.french.FrenchTreebankLanguagePack -cPOS
35 | ```
36 |
37 | * UD train/dev/test data for a variety of languages can be found [here](http://universaldependencies.org/)
38 | * There are many places to find word embedding data, in this example Facebook fastText embeddings are being used, they are found [here](https://github.com/facebookresearch/fastText/blob/master/pretrained-vectors.md)
39 | * Note that you need a tokenizer for your language that matches the tokenization of the UD training files, you may have to reprocess the files to match the tokenizing you plan to use
40 | * Likewise, if you use the `-cPOS` setting, you will have to have POS tags that match the UD training data
41 | * The amount of RAM necessary to train the model may vary depending on various factors
42 |
43 | ## More information
44 |
45 | For details about the dependency software, see [this page](http://nlp.stanford.edu/software/nndep.html). For more details about dependency parsing in general, see [this page](http://nlp.stanford.edu/software/stanford-dependencies.html).
46 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/buttons.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Buttons and things that look like buttons
3 | //
4 | // stylelint-disable color-named
5 |
6 | .btn {
7 | display: inline-block;
8 | box-sizing: border-box;
9 | padding-top: 0.3em;
10 | padding-right: 1em;
11 | padding-bottom: 0.3em;
12 | padding-left: 1em;
13 | margin: 0;
14 | font-family: inherit;
15 | font-size: inherit;
16 | font-weight: 500;
17 | line-height: 1.5;
18 | color: $link-color;
19 | text-decoration: none;
20 | vertical-align: baseline;
21 | cursor: pointer;
22 | background-color: $base-button-color;
23 | border-width: 0;
24 | border-radius: $border-radius;
25 | box-shadow: 0 1px 2px rgba(0, 0, 0, 0.12), 0 3px 10px rgba(0, 0, 0, 0.08);
26 | appearance: none;
27 |
28 | &:focus {
29 | text-decoration: none;
30 | outline: none;
31 | box-shadow: 0 0 0 3px rgba(blue, 0.25);
32 | }
33 |
34 | &:focus:hover,
35 | &.selected:focus {
36 | box-shadow: 0 0 0 3px rgba(blue, 0.25);
37 | }
38 |
39 | &:hover,
40 | &.zeroclipboard-is-hover {
41 | color: darken($link-color, 2%);
42 | }
43 |
44 | &:hover,
45 | &:active,
46 | &.zeroclipboard-is-hover,
47 | &.zeroclipboard-is-active {
48 | text-decoration: none;
49 | background-color: darken($base-button-color, 1%);
50 | }
51 |
52 | &:active,
53 | &.selected,
54 | &.zeroclipboard-is-active {
55 | background-color: darken($base-button-color, 3%);
56 | background-image: none;
57 | box-shadow: inset 0 2px 4px rgba(0, 0, 0, 0.15);
58 | }
59 |
60 | &.selected:hover {
61 | background-color: darken(#dcdcdc, 5%);
62 | }
63 |
64 | &:disabled,
65 | &.disabled {
66 | &,
67 | &:hover {
68 | color: rgba(102, 102, 102, 0.5);
69 | cursor: default;
70 | background-color: rgba(229, 229, 229, 0.5);
71 | background-image: none;
72 | box-shadow: none;
73 | }
74 | }
75 | }
76 |
77 | .btn-outline {
78 | color: $link-color;
79 | background: transparent;
80 | box-shadow: inset 0 0 0 2px $grey-lt-300;
81 |
82 | &:hover,
83 | &:active,
84 | &.zeroclipboard-is-hover,
85 | &.zeroclipboard-is-active {
86 | color: darken($link-color, 4%);
87 | text-decoration: none;
88 | background-color: transparent;
89 | box-shadow: inset 0 0 0 3px $grey-lt-300;
90 | }
91 |
92 | &:focus {
93 | text-decoration: none;
94 | outline: none;
95 | box-shadow: inset 0 0 0 2px $grey-dk-100, 0 0 0 3px rgba(blue, 0.25);
96 | }
97 |
98 | &:focus:hover,
99 | &.selected:focus {
100 | box-shadow: inset 0 0 0 2px $grey-dk-100;
101 | }
102 | }
103 |
104 | .btn-primary {
105 | @include btn-color($white, $btn-primary-color);
106 | }
107 |
108 | .btn-purple {
109 | @include btn-color($white, $purple-100);
110 | }
111 |
112 | .btn-blue {
113 | @include btn-color($white, $blue-000);
114 | }
115 |
116 | .btn-green {
117 | @include btn-color($white, $green-100);
118 | }
119 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/pos.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Parts Of Speech
4 | keywords: pos, POSTaggerAnnotator
5 | permalink: '/pos.html'
6 | nav_order: 9
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Part of speech tagging assigns part of speech labels to tokens, such as whether they are verbs or nouns. Every token in a sentence is applied
13 | a tag. For instance, in the sentence `Marie was born in Paris.` the word `Marie` is assigned the tag `NNP`.
14 |
15 | | Name | Annotator class name | Requirement | Generated Annotation | Description |
16 | | --- | --- | --- | --- | --- |
17 | | pos | POSTaggerAnnotator | TokensAnnotation, SentencesAnnotation | PartOfSpeechAnnotation | Applies part of speech tags to tokens. |
18 |
19 | ## Options
20 |
21 | | Option name | Type | Default | Description |
22 | | --- | --- | --- | --- |
23 | | pos.model | String | edu/stanford/nlp/models/pos-tagger/english-left3words-distsim.tagger | Model to use for part of speech tagging. |
24 | | pos.maxlen | int | Integer.MAX_VALUE | Maximum sentence length to tag. Sentences longer than this will not be tagged. |
25 |
26 |
27 | ## Part Of Speech Tagging From The Command Line
28 |
29 | This command will apply part of speech tags to the input text:
30 |
31 | ```bash
32 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos -file input.txt
33 | ```
34 |
35 | Other output formats include `conllu`, `conll`, `json`, and `serialized`.
36 |
37 | This command will apply part of speech tags using a non-default model (e.g. the more powerful but slower bidirectional model):
38 |
39 | ```bash
40 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos -pos.model edu/stanford/nlp/models/pos-tagger/english-bidirectional-distsim.tagger -file input.txt
41 | ```
42 |
43 | If running on French, German, or Spanish, it is crucial to use the MWT annotator:
44 |
45 | ```bash
46 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -props french -annotators tokenize,ssplit,mwt,pos -file input.txt
47 | ```
48 |
49 | ## Part Of Speech Tagging From Java
50 |
51 | ```
52 | package edu.stanford.nlp.examples;
53 |
54 | import edu.stanford.nlp.ling.*;
55 | import edu.stanford.nlp.pipeline.*;
56 |
57 | import java.util.*;
58 |
59 | public class POSTaggingExample {
60 |
61 | public static String text = "Marie was born in Paris.";
62 |
63 | public static void main(String[] args) {
64 | // set up pipeline properties
65 | Properties props = new Properties();
66 | // set the list of annotators to run
67 | props.setProperty("annotators", "tokenize,ssplit,pos");
68 | // build pipeline
69 | StanfordCoreNLP pipeline = new StanfordCoreNLP(props);
70 | // create a document object
71 | CoreDocument document = pipeline.processToCoreDocument(text);
72 | // display tokens
73 | for (CoreLabel tok : document.tokens()) {
74 | System.out.println(String.format("%s\t%s", tok.word(), tok.tag()));
75 | }
76 | }
77 | }
78 | ```
79 |
80 | This demo code will print out the part of speech labels for each token:
81 |
82 | ```
83 | Marie NNP
84 | was VBD
85 | born VBN
86 | in IN
87 | Paris NNP
88 | . .
89 | ```
90 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/content.scss:
--------------------------------------------------------------------------------
1 | @charset "UTF-8";
2 |
3 | //
4 | // Styles for rendered markdown in the .main-content container
5 | //
6 | // stylelint-disable selector-no-type, max-nesting-depth, selector-max-compound-selectors, selector-max-type
7 |
8 | .page-content {
9 | line-height: $content-line-height;
10 |
11 | a {
12 | overflow: hidden;
13 | text-overflow: ellipsis;
14 | white-space: nowrap;
15 | }
16 |
17 | ul,
18 | ol {
19 | padding-left: 1.5em;
20 | }
21 |
22 | ol {
23 | list-style-type: none;
24 | counter-reset: step-counter;
25 |
26 | > li {
27 | position: relative;
28 |
29 | &::before {
30 | position: absolute;
31 | top: 0.2em;
32 | left: -1.6em;
33 | color: $grey-dk-000;
34 | content: counter(step-counter);
35 | counter-increment: step-counter;
36 | @include fs-3;
37 |
38 | @include mq(sm) {
39 | top: 0.11em;
40 | }
41 | }
42 |
43 | ol {
44 | counter-reset: sub-counter;
45 |
46 | li {
47 | &::before {
48 | content: counter(sub-counter, lower-alpha);
49 | counter-increment: sub-counter;
50 | }
51 | }
52 | }
53 | }
54 | }
55 |
56 | ul {
57 | list-style: none;
58 |
59 | > li {
60 | &::before {
61 | position: absolute;
62 | margin-left: -1.4em;
63 | color: $grey-dk-000;
64 | content: "•";
65 | }
66 | }
67 | }
68 |
69 | .task-list {
70 | padding-left: 0;
71 | }
72 |
73 | .task-list-item {
74 | display: flex;
75 | align-items: center;
76 |
77 | &::before {
78 | content: "";
79 | }
80 | }
81 |
82 | .task-list-item-checkbox {
83 | margin-right: 0.6em;
84 | }
85 |
86 | hr + * {
87 | margin-top: 0;
88 | }
89 |
90 | h1:first-of-type {
91 | margin-top: 0.5em;
92 | }
93 |
94 | dl {
95 | display: grid;
96 | grid-template-columns: max-content 1fr;
97 | }
98 |
99 | dt,
100 | dd {
101 | margin: 0.25em 0;
102 | }
103 |
104 | dt {
105 | text-align: right;
106 |
107 | &::after {
108 | content: ":";
109 | }
110 | }
111 |
112 | dd {
113 | margin-left: 1em;
114 | font-weight: 500;
115 | }
116 |
117 | .anchor-heading {
118 | position: absolute;
119 | right: -$sp-4;
120 | width: $sp-5;
121 | height: 100%;
122 | padding-right: $sp-1;
123 | padding-left: $sp-1;
124 | overflow: visible;
125 |
126 | @include mq(md) {
127 | right: auto;
128 | left: -$sp-5;
129 | }
130 |
131 | svg {
132 | display: inline-block;
133 | width: 100%;
134 | height: 100%;
135 | fill: $link-color;
136 | visibility: hidden;
137 | }
138 | }
139 |
140 | .anchor-heading:hover,
141 | h1:hover > .anchor-heading,
142 | h2:hover > .anchor-heading,
143 | h3:hover > .anchor-heading,
144 | h4:hover > .anchor-heading,
145 | h5:hover > .anchor-heading,
146 | h6:hover > .anchor-heading {
147 | svg {
148 | visibility: visible;
149 | }
150 | }
151 |
152 | h1,
153 | h2,
154 | h3,
155 | h4,
156 | h5,
157 | h6 {
158 | position: relative;
159 | }
160 | }
161 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/pipeline.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Pipeline
4 | keywords: pipeline
5 | permalink: '/pipeline.html'
6 | nav_order: 4
7 | has_children: true
8 | ---
9 |
10 | # Pipeline
11 |
12 | The centerpiece of CoreNLP is the pipeline. Pipelines take in text or xml and generate full annotation objects.
13 |
14 | requirementsSatisfied();
51 | public Set requires();
52 | ```
53 |
54 | With a custom analysis pipeline, only the first method is used. The other two methods are used in `StanfordCoreNLP` to check for dependencies between `Annotator`s.
55 |
56 | A new thing provided with v.3.9 of CoreNLP is a default `WebServiceAnnotator`. This is an abstract implementation of an `Annotator` that makes it relatively easy to tie external webservices into a CoreNLP `AnnotationPipeline`. You simply have to provide a class that extends this class and which specifies three methods which say how to call your webservice, how to check if it’s running, and (optionally) how to start the webservice.
57 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/quote.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Quote Extraction And Attribution
4 | keywords: quote, QuoteAnnotator, quote attribution
5 | permalink: '/quote.html'
6 | nav_order: 18
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Deterministically picks out quotes from a text. All top-level quotes, are supplied by the top level annotation for a text. If a QuotationAnnotation corresponds to a quote that contains embedded quotes, these quotes will appear as embedded QuotationAnnotations that can be accessed from the QuotationAnnotation that they are embedded in. The QuoteAnnotator can handle multi-line and cross-paragraph quotes, but any embedded quotes must be delimited by a different kind of quotation mark than its parents.
13 |
14 | Allows for embedded quotations so long as they are either directed unicode quotes or are of a different type of quote than the outer quotations (e.g. "'Gadzooks' is what he said to me" is legal whereas "They called me "Danger" when I was..." is illegal). Uses regular-expression-like rules to find quotes and does not depend on the tokenizer, which allows quotes like ''Tis true!' to be correctly identified.
15 |
16 | Considers regular ascii ("", '', \`\`'', and \`') as well as "smart" and international quotation marks as follows: “”,‘’, «», ‹›, 「」, 『』, „”, and ‚’.
17 |
18 | Note: extracts everything within these pairs as a whole quote segment, which may or may not be the desired behaviour for texts that use different formatting styles than standard english ones.
19 |
20 |
21 | | Property name | Annotator class name | Generated Annotation |
22 | | --- | --- | --- |
23 | | quote | QuoteAnnotator | QuotationsAnnotation, CharacterOffsetBeginAnnotation, CharacterOffsetEndAnnotation, QuotationIndexAnnotation, QuotationsAnnotation (if embedded quotes), TokensAnnotation (if tokenize present), TokenBeginAnnotation (if tokenize present), TokenEndAnnotation (if tokenize present), SentenceBeginAnnotation (if ssplit present), SentenceEndAnnotation (if ssplit present) |
24 |
25 | ## Quote Attribution
26 |
27 | As of version 3.9.1 of Stanford CoreNLP, the QuoteAnnotator will also try to attribute the quotes by default.
28 |
29 | This can be deactivated by setting the `quote.attributeQuotes` property to `false.`
30 |
31 | ## Sample Command Line
32 |
33 | If you run this command:
34 |
35 | ```bash
36 | java -Xmx10g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos,lemma,ner,depparse,coref,quote -file quote-example.txt -outputFormat text
37 | ```
38 |
39 | On this text `quote-example.txt`:
40 |
41 | ```
42 | In the summer Joe Smith decided to go on vacation. He said, "I'm going to Hawaii." That July, vacationer Joe went to Hawaii.
43 | ```
44 |
45 | You should get this output for the quote in the text:
46 |
47 | ```
48 | Extracted quotes:
49 | [QuotationIndex=0, CharacterOffsetBegin=61, Text="I'm going to Hawaii.", Speaker=Joe Smith]
50 | ```
51 |
52 | If you didn't want to run quote attribution, you would add `-quote.attributeQuotes false` to your command.
53 |
54 |
55 | ## Options
56 |
57 | * quote.singleQuotes: "true" or "false", indicating whether or not to consider ' tokens (single quotes) to be quotation marks (default=false).
58 | * quote.maxLength: maximum character length of quotes to consider (default=-1).
59 | * quote.asciiQuotes: "true" or "false", indicating whether or not to convert all quotes to ascii quotes before processing (can help when there are errors in quote directionality) (default=false).
60 | * quote.allowEmbeddedSame: "true" or "false" indicating whether or not to allow smart/directed (everything except " and ') quotes of the same kind to be embedded within one another (default=false).
61 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/head.html:
--------------------------------------------------------------------------------
1 |
2 |
3 |
4 |
5 | {% if site.plugins.jekyll-seo == nil %}
6 | {{ page.title }} - {{ site.title }}
7 |
8 | {% if page.description %}
9 |
10 | {% endif %}
11 |
12 | {% if page.keywords %}
13 |
14 | {% endif %}
15 | {% endif %}
16 |
17 |
18 |
19 |
20 |
21 |
22 |
23 | {% if site.ga_tracking != nil %}
24 |
25 |
32 |
33 | {% endif %}
34 |
35 | {% if page.datatable == true %}
36 |
37 |
38 |
39 |
67 | {% endif %}
68 |
69 | {% if site.search_enabled != false %}
70 |
71 | {% endif %}
72 |
73 |
74 |
75 |
76 | {% seo %}
77 |
78 | {% include head_custom.html %}
79 |
80 |
81 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/initialize_shuffle.html:
--------------------------------------------------------------------------------
1 |
7 |
8 |
100 |
101 |
102 |
103 |
114 |
115 |
129 |
130 |
131 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/search.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Search input and autocomplete
3 | //
4 |
5 | .search {
6 | position: relative;
7 | z-index: 99;
8 | flex-grow: 1;
9 | height: 100%;
10 | margin-bottom: $sp-3;
11 |
12 | @include mq(md) {
13 | margin-bottom: 0;
14 | }
15 | }
16 |
17 | .search-input-wrap {
18 | display: flex;
19 | height: 100%;
20 | padding: $sp-2;
21 | background-color: $search-background-color;
22 | border-radius: $border-radius;
23 | box-shadow: 0 1px 2px rgba(0, 0, 0, 0.12), 0 3px 10px rgba(0, 0, 0, 0.08);
24 |
25 | @include mq(md) {
26 | padding-top: 0;
27 | padding-right: 0;
28 | padding-bottom: 0;
29 | padding-left: 0;
30 | background-color: $body-background-color;
31 | border-radius: 0;
32 | box-shadow: none;
33 | }
34 | }
35 |
36 | .search-input {
37 | align-self: center;
38 | width: 100%;
39 | padding-top: $sp-1;
40 | padding-bottom: $sp-1;
41 | background-color: $search-background-color;
42 | border-top: 0;
43 | border-right: 0;
44 | border-bottom: 0;
45 | border-left: 0;
46 | order: 2;
47 | @include fs-4;
48 |
49 | &:focus {
50 | outline: 0;
51 | box-shadow: none;
52 |
53 | + .search-icon {
54 | fill: $link-color;
55 | }
56 | }
57 |
58 | @include mq(md) {
59 | background-color: $body-background-color;
60 | @include fs-3;
61 | }
62 | }
63 |
64 | .search-icon {
65 | align-self: center;
66 | margin-right: $sp-2;
67 | fill: $grey-dk-000;
68 | order: 1;
69 | }
70 |
71 | .search-results-wrap {
72 | position: absolute;
73 | z-index: 100;
74 | display: none;
75 | width: 100%;
76 | background: $search-background-color;
77 | border-radius: $border-radius;
78 | box-shadow: 0 1px 2px rgba(0, 0, 0, 0.12), 0 3px 10px rgba(0, 0, 0, 0.08);
79 |
80 | &.active {
81 | display: block;
82 | }
83 |
84 | @include mq(md) {
85 | width: $search-results-width;
86 | }
87 | }
88 |
89 | .search-results-list {
90 | padding-left: 0;
91 | margin-top: $sp-1;
92 | margin-bottom: $sp-1;
93 | list-style: none;
94 | @include fs-4;
95 |
96 | @include mq(md) {
97 | @include fs-3;
98 | }
99 | }
100 |
101 | .search-results-list-item {
102 | padding: 0;
103 | margin: 0;
104 | }
105 |
106 | .search-result {
107 | display: block;
108 | padding-top: $sp-1;
109 | padding-right: $sp-3;
110 | padding-bottom: $sp-1;
111 | padding-left: $sp-3;
112 |
113 | &:hover,
114 | &.active {
115 | background-color: $sidebar-color;
116 | }
117 |
118 | @include mq(md) {
119 | padding-right: $sp-4;
120 | padding-left: $sp-4;
121 | }
122 | }
123 |
124 | .search-result-title {
125 | display: block;
126 | padding-top: $sp-2;
127 | padding-right: $sp-4;
128 | padding-bottom: $sp-2;
129 |
130 | @include mq(sm) {
131 | display: inline-block;
132 | width: 40%;
133 | word-wrap: break-word;
134 | vertical-align: top;
135 | }
136 | }
137 |
138 | .search-result-rel-url {
139 | display: block;
140 | overflow: hidden;
141 | color: $search-result-preview-color;
142 | text-overflow: ellipsis;
143 | white-space: nowrap;
144 | @include fs-1;
145 | }
146 |
147 | .search-result-preview {
148 | display: block;
149 | padding-top: $sp-2;
150 | padding-bottom: $sp-2;
151 | padding-left: $sp-4;
152 | color: $search-result-preview-color;
153 | border-left: $border;
154 | border-left-color: $border-color;
155 | @include fs-2;
156 |
157 | @include mq(sm) {
158 | display: inline-block;
159 | width: 60%;
160 | vertical-align: top;
161 | }
162 | }
163 |
164 | .search-result-highlight {
165 | font-weight: bold;
166 | color: $link-color;
167 | }
168 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/sidebar.html:
--------------------------------------------------------------------------------
1 |
2 |
{%endcapture %} 9 | {% capture hr_shaded %}
{%endcapture %} -------------------------------------------------------------------------------- /Single_Cycle_CPU/Single_cycle_implementation/regfile.v: -------------------------------------------------------------------------------- 1 | `timescale 1ns / 1ps 2 | //Regfile module 3 | 4 | module regfile( 5 | input clk, 6 | input [4:0] rs1, 7 | input [4:0] rs2, 8 | input [4:0] rd, 9 | input [31:0] regdata, 10 | input wer, 11 | output [31:0] rv1, 12 | output [31:0] rv2, 13 | output [31:0] x31 14 | ); 15 | reg [31:0] r[0:31]; 16 | integer i; 17 | initial begin 18 | r[31] = 0; 19 | for(i=0; i<31; i = i+1) 20 | r[i]=i; 21 | end 22 | assign rv1 = r[rs1]; 23 | assign rv2 = r[rs2]; 24 | assign x31 = r[31]; 25 | always @(posedge clk) 26 | begin 27 | if(wer && rd!=0) 28 | r[rd] = regdata; 29 | end 30 | endmodule 31 | -------------------------------------------------------------------------------- /Pipelined_CPU/pipeline_CPU_tb.v: -------------------------------------------------------------------------------- 1 | `timescale 1ns / 1ps 2 | 3 | module pipeline_cpu_tb(); 4 | reg clk, reset; 5 | wire [31:0] iaddr; 6 | wire [31:0] x31; 7 | wire [31:0] EM_daddr_out; 8 | wire [31:0] MW_drdata_out; 9 | wire [31:0] L_regdata_out; 10 | 11 | pipeline_CPU dut( 12 | .clk(clk), 13 | .reset(reset), 14 | .iaddr(iaddr), 15 | .x31(x31), 16 | .EM_daddr_out(EM_daddr_out), 17 | .MW_drdata_out(MW_drdata_out), 18 | .L_regdata_out(L_regdata_out) 19 | ); 20 | 21 | always #5 clk = ~clk; 22 | initial begin 23 | clk = 0; 24 | reset = 1; 25 | #30; 26 | reset = 0; 27 | $finish; 28 | end 29 | endmodule 30 | -------------------------------------------------------------------------------- /CoreNLP-gh-pages/_sass/labels.scss: -------------------------------------------------------------------------------- 1 | // 2 | // Labels (not the form kind) 3 | // 4 | 5 | .label, 6 | .label-blue { 7 | display: inline-block; 8 | padding-top: 0.16em; 9 | padding-right: 0.42em; 10 | padding-bottom: 0.16em; 11 | padding-left: 0.42em; 12 | margin-right: $sp-1; 13 | margin-left: $sp-1; 14 | color: $white; 15 | text-transform: uppercase; 16 | vertical-align: middle; 17 | background-color: $blue-100; 18 | @include fs-2; 19 | } 20 | 21 | .label-green { 22 | background-color: $green-200; 23 | } 24 | 25 | .label-purple { 26 | background-color: $purple-100; 27 | } 28 | 29 | .label-red { 30 | background-color: $red-200; 31 | } 32 | 33 | .label-yellow { 34 | color: $grey-dk-200; 35 | background-color: $yellow-200; 36 | } 37 | -------------------------------------------------------------------------------- /Pipelined_Branch_Predict/cpu_tb.v: -------------------------------------------------------------------------------- 1 | `timescale 1ns / 1ps 2 | 3 | module pipeline_cpu_tb(); 4 | reg clk, reset; //check.. drdata and idata should be reg?????? 5 | wire [31:0] iaddr; 6 | wire [31:0] x31; 7 | wire [31:0] L_regdata_out; 8 | wire [31:0] EM_daddr_out; 9 | wire [31:0] MW_drdata_out; 10 | 11 | pipeline_CPU dut( 12 | .clk(clk), 13 | .reset(reset), 14 | .iaddr(iaddr), 15 | .x31(x31), 16 | .L_regdata_out(L_regdata_out), 17 | .EM_daddr_out(EM_daddr_out), 18 | .MW_drdata_out(MW_drdata_out) 19 | ); 20 | 21 | always #5 clk = ~clk; 22 | initial begin 23 | clk = 0; 24 | reset = 1; 25 | #30; 26 | reset = 0; 27 | $finish; 28 | end 29 | endmodule 30 | -------------------------------------------------------------------------------- /CoreNLP-gh-pages/_includes/taglogic.html: -------------------------------------------------------------------------------- 1 |
The following pages are tagged with
2 || Page | Excerpt |
|---|---|
| {{page.title}} | 10 |{% if page.summary %} {{ page.summary | strip_html | strip_newlines | truncate: 160 }} {% else %} {{ page.content | truncatewords: 50 | strip_html }} {% endif %} | 11 |
2 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/cleanxml.properties:
--------------------------------------------------------------------------------
1 | clean.xmltags = headline|dateline|text|post
2 | clean.singlesentencetags = HEADLINE|DATELINE|SPEAKER|POSTER|POSTDATE
3 | clean.sentenceendingtags = P|POST|QUOTE
4 | clean.turntags = TURN|POST|QUOTE
5 | clean.speakertags = SPEAKER|POSTER
6 | clean.docidtags = DOCID
7 | clean.datetags = DATETIME|DATE|DATELINE
8 | clean.doctypetags = DOCTYPE
9 | clean.docAnnotations = docID=doc[id],doctype=doc[type],docsourcetype=doctype[source]
10 | clean.sectiontags = HEADLINE|DATELINE|POST
11 | clean.sectionAnnotations = sectionID=post[id],sectionDate=post[date|datetime],sectionDate=postdate,author=post[author],author=poster
12 | clean.quotetags = quote
13 | clean.quoteauthorattributes = orig_author
14 | clean.tokenAnnotations = link=a[href],speaker=post[author],speaker=quote[orig_author]
15 | clean.ssplitDiscardTokens = \\n|\\*NL\\*
16 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/assets/js/search-data.json:
--------------------------------------------------------------------------------
1 | ---
2 | ---
3 | {
4 | {% assign comma = false %}
5 | {% for page in site.html_pages %}{% if page.search_exclude != true %}{% if comma == true%},{% endif %}"{{ forloop.index0 }}": {
6 | "title": "{{ page.title | replace: '&', '&' }}",
7 | "content": "{{ page.content | markdownify | replace: '
2 |
3 |
4 |
5 | {% include head_print.html %}
6 |
7 |
8 |
9 |
10 |
11 |
12 |
13 |
14 |
15 |
16 |
3 |
4 |
18 |
19 |
17 |
18 |
24 |
25 |
26 |
27 |
28 |
29 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/support/mixins/_layout.scss:
--------------------------------------------------------------------------------
1 | // Media query
2 |
3 | // Media query mixin
4 | // Usage:
5 | // @include mq(md) {
6 | // ..medium and up styles
7 | // }
8 | @mixin mq($name) {
9 | // Retrieves the value from the key
10 | $value: map-get($media-queries, $name);
11 |
12 | // If the key exists in the map
13 | @if $value != null {
14 | // Prints a media query based on the value
15 | @media (min-width: rem($value)) {
16 | @content;
17 | }
18 | } @else {
19 | @warn "No value could be retrieved from `#{$media-query}`. "
20 | + "Please make sure it is defined in `$media-queries` map.";
21 | }
22 | }
23 |
24 | // Responsive container
25 |
26 | @mixin container {
27 | padding-right: $gutter-spacing-sm;
28 | padding-left: $gutter-spacing-sm;
29 |
30 | @include mq(md) {
31 | padding-right: $gutter-spacing;
32 | padding-left: $gutter-spacing;
33 | }
34 | }
35 |
--------------------------------------------------------------------------------
/Single_Cycle_CPU/Single_cycle_implementation/B_type.v:
--------------------------------------------------------------------------------
1 | `timescale 1ns / 1ps
2 | //Module for branch instructions - The new pc value is generated by this module
3 | module B_type(
4 | input [31:0] instr,
5 | input [31:0] iaddr,
6 | input signed [31:0] imm,
7 | input signed [31:0] in1, in2,
8 | output reg [31:0] out
9 | );
10 | wire [31:0] tmp1, tmp2;
11 | assign tmp1 = in1;
12 | assign tmp2 = in2;
13 | always@(instr or in1 or in2 or iaddr or imm)
14 | begin
15 | case(instr[14:12])
16 | 3'b000: out = (in1==in2)? (iaddr+imm) : (iaddr+4);
17 | 3'b001: out = (in1!=in2)? (iaddr+imm) : (iaddr+4);
18 | 3'b100: out = (in1
19 |
20 | {{content}}
21 |
22 |
23 |
8 | 11 | Yesterday afternoon as I negotiated route 149 from Lake George to Fort Ann in NY I passed a new diner that had opened that day. I didnt notice the name but out side it had a Union Jack and a St Georges flag flying 12 | I wonder if they serve proper 'English' food, served by proper 'English' people ? I may have to check it out asap14 | If they don't have english food and beer...tell em they've got a bloody cheek flying the flags and luring un-suspecting expats in....little buggers...
15 | 18 | Yesterday afternoon as I negotiated route 149 from Lake George to Fort Ann in NY I passed a new diner that had opened that day. I didnt notice the name but out side it had a Union Jack and a St Georges flag flying 19 | I wonder if they serve proper 'English' food, served by proper 'English' people ? I may have to check it out asap21 | Halal? 22 |
25 | Halal? 26 |27 | Tandoori. 28 |
"
41 | # - "//pypi.org/project/stanza/"
42 | # ""
43 | # - "//anaconda.org/stanfordnlp/stanza"
44 | # ""
45 | # - "//pypi.org/project/stanza/"
46 |
47 | # Footer content appears at the bottom of every page's main content
48 | footer_content: "Copyright © 2020 Stanford NLP Group."
49 |
50 | # Color scheme currently only supports "dark" or nil (default)
51 | color_scheme: nil
52 |
53 | # Google Analytics Tracking (optional)
54 | # e.g, UA-1234567-89
55 | ga_tracking: UA-133356038-1
56 |
57 | plugins:
58 | - jekyll-seo-tag
59 | - jekyll-relative-links
60 |
61 | compress_html:
62 | clippings: all
63 | comments: all
64 | endings: all
65 | startings: []
66 | blanklines: false
67 | profile: false
68 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/depparse.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Dependency Parsing
4 | keywords: depparse, DependencyParseAnnotator, dependency parsing
5 | permalink: '/depparse.html'
6 | nav_order: 12
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Provides a fast syntactic dependency parser. We generate three dependency-based outputs, as follows: basic, uncollapsed dependencies, saved in BasicDependenciesAnnotation; enhanced dependencies saved in EnhancedDependenciesAnnotation; and enhanced++ dependencies in EnhancedPlusPlusDependenciesAnnotation. Most users of our parser will prefer the latter representation.
13 |
14 | This is a separate annotator for a direct dependency parser. These
15 | parsers require prior part-of-speech tagging. If you need constituency
16 | parses then you should look at the `parse` annotator.
17 |
18 | | Property name | Annotator class name | Generated Annotation |
19 | | --- | --- | --- |
20 | | depparse | DependencyParseAnnotator | BasicDependenciesAnnotation, EnhancedDependenciesAnnotation, EnhancedPlusPlusDependenciesAnnotation |
21 |
22 | ## Options
23 |
24 | | Option name | Type | Default | Description |
25 | | --- | --- | --- | --- |
26 | | depparse.model | file, classpath, or URL | edu/stanford/nlp/models/parser/nndep/english\_UD.gz | Dependency parsing model to use. There is no need to explicitly set this option, unless you want to use a different parsing model than the default. By default, this is set to the UD parsing model included in the stanford-corenlp-models JAR file. |
27 |
28 |
29 | ## Training a model
30 |
31 | Here is an example command for training your own model. In this example we will train a French dependency parser.
32 |
33 | ```bash
34 | java -Xmx12g edu.stanford.nlp.parser.nndep.DependencyParser -trainFile fr-ud-train.conllu -devFile fr-ud-dev.conllu -model new-french-UD-model.txt.gz -embedFile wiki.fr.vec -embeddingSize 300 -tlp edu.stanford.nlp.trees.international.french.FrenchTreebankLanguagePack -cPOS
35 | ```
36 |
37 | * UD train/dev/test data for a variety of languages can be found [here](http://universaldependencies.org/)
38 | * There are many places to find word embedding data, in this example Facebook fastText embeddings are being used, they are found [here](https://github.com/facebookresearch/fastText/blob/master/pretrained-vectors.md)
39 | * Note that you need a tokenizer for your language that matches the tokenization of the UD training files, you may have to reprocess the files to match the tokenizing you plan to use
40 | * Likewise, if you use the `-cPOS` setting, you will have to have POS tags that match the UD training data
41 | * The amount of RAM necessary to train the model may vary depending on various factors
42 |
43 | ## More information
44 |
45 | For details about the dependency software, see [this page](http://nlp.stanford.edu/software/nndep.html). For more details about dependency parsing in general, see [this page](http://nlp.stanford.edu/software/stanford-dependencies.html).
46 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/buttons.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Buttons and things that look like buttons
3 | //
4 | // stylelint-disable color-named
5 |
6 | .btn {
7 | display: inline-block;
8 | box-sizing: border-box;
9 | padding-top: 0.3em;
10 | padding-right: 1em;
11 | padding-bottom: 0.3em;
12 | padding-left: 1em;
13 | margin: 0;
14 | font-family: inherit;
15 | font-size: inherit;
16 | font-weight: 500;
17 | line-height: 1.5;
18 | color: $link-color;
19 | text-decoration: none;
20 | vertical-align: baseline;
21 | cursor: pointer;
22 | background-color: $base-button-color;
23 | border-width: 0;
24 | border-radius: $border-radius;
25 | box-shadow: 0 1px 2px rgba(0, 0, 0, 0.12), 0 3px 10px rgba(0, 0, 0, 0.08);
26 | appearance: none;
27 |
28 | &:focus {
29 | text-decoration: none;
30 | outline: none;
31 | box-shadow: 0 0 0 3px rgba(blue, 0.25);
32 | }
33 |
34 | &:focus:hover,
35 | &.selected:focus {
36 | box-shadow: 0 0 0 3px rgba(blue, 0.25);
37 | }
38 |
39 | &:hover,
40 | &.zeroclipboard-is-hover {
41 | color: darken($link-color, 2%);
42 | }
43 |
44 | &:hover,
45 | &:active,
46 | &.zeroclipboard-is-hover,
47 | &.zeroclipboard-is-active {
48 | text-decoration: none;
49 | background-color: darken($base-button-color, 1%);
50 | }
51 |
52 | &:active,
53 | &.selected,
54 | &.zeroclipboard-is-active {
55 | background-color: darken($base-button-color, 3%);
56 | background-image: none;
57 | box-shadow: inset 0 2px 4px rgba(0, 0, 0, 0.15);
58 | }
59 |
60 | &.selected:hover {
61 | background-color: darken(#dcdcdc, 5%);
62 | }
63 |
64 | &:disabled,
65 | &.disabled {
66 | &,
67 | &:hover {
68 | color: rgba(102, 102, 102, 0.5);
69 | cursor: default;
70 | background-color: rgba(229, 229, 229, 0.5);
71 | background-image: none;
72 | box-shadow: none;
73 | }
74 | }
75 | }
76 |
77 | .btn-outline {
78 | color: $link-color;
79 | background: transparent;
80 | box-shadow: inset 0 0 0 2px $grey-lt-300;
81 |
82 | &:hover,
83 | &:active,
84 | &.zeroclipboard-is-hover,
85 | &.zeroclipboard-is-active {
86 | color: darken($link-color, 4%);
87 | text-decoration: none;
88 | background-color: transparent;
89 | box-shadow: inset 0 0 0 3px $grey-lt-300;
90 | }
91 |
92 | &:focus {
93 | text-decoration: none;
94 | outline: none;
95 | box-shadow: inset 0 0 0 2px $grey-dk-100, 0 0 0 3px rgba(blue, 0.25);
96 | }
97 |
98 | &:focus:hover,
99 | &.selected:focus {
100 | box-shadow: inset 0 0 0 2px $grey-dk-100;
101 | }
102 | }
103 |
104 | .btn-primary {
105 | @include btn-color($white, $btn-primary-color);
106 | }
107 |
108 | .btn-purple {
109 | @include btn-color($white, $purple-100);
110 | }
111 |
112 | .btn-blue {
113 | @include btn-color($white, $blue-000);
114 | }
115 |
116 | .btn-green {
117 | @include btn-color($white, $green-100);
118 | }
119 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/pos.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Parts Of Speech
4 | keywords: pos, POSTaggerAnnotator
5 | permalink: '/pos.html'
6 | nav_order: 9
7 | parent: Pipeline
8 | ---
9 |
10 | ## Description
11 |
12 | Part of speech tagging assigns part of speech labels to tokens, such as whether they are verbs or nouns. Every token in a sentence is applied
13 | a tag. For instance, in the sentence `Marie was born in Paris.` the word `Marie` is assigned the tag `NNP`.
14 |
15 | | Name | Annotator class name | Requirement | Generated Annotation | Description |
16 | | --- | --- | --- | --- | --- |
17 | | pos | POSTaggerAnnotator | TokensAnnotation, SentencesAnnotation | PartOfSpeechAnnotation | Applies part of speech tags to tokens. |
18 |
19 | ## Options
20 |
21 | | Option name | Type | Default | Description |
22 | | --- | --- | --- | --- |
23 | | pos.model | String | edu/stanford/nlp/models/pos-tagger/english-left3words-distsim.tagger | Model to use for part of speech tagging. |
24 | | pos.maxlen | int | Integer.MAX_VALUE | Maximum sentence length to tag. Sentences longer than this will not be tagged. |
25 |
26 |
27 | ## Part Of Speech Tagging From The Command Line
28 |
29 | This command will apply part of speech tags to the input text:
30 |
31 | ```bash
32 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos -file input.txt
33 | ```
34 |
35 | Other output formats include `conllu`, `conll`, `json`, and `serialized`.
36 |
37 | This command will apply part of speech tags using a non-default model (e.g. the more powerful but slower bidirectional model):
38 |
39 | ```bash
40 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,pos -pos.model edu/stanford/nlp/models/pos-tagger/english-bidirectional-distsim.tagger -file input.txt
41 | ```
42 |
43 | If running on French, German, or Spanish, it is crucial to use the MWT annotator:
44 |
45 | ```bash
46 | java -Xmx5g edu.stanford.nlp.pipeline.StanfordCoreNLP -props french -annotators tokenize,ssplit,mwt,pos -file input.txt
47 | ```
48 |
49 | ## Part Of Speech Tagging From Java
50 |
51 | ```
52 | package edu.stanford.nlp.examples;
53 |
54 | import edu.stanford.nlp.ling.*;
55 | import edu.stanford.nlp.pipeline.*;
56 |
57 | import java.util.*;
58 |
59 | public class POSTaggingExample {
60 |
61 | public static String text = "Marie was born in Paris.";
62 |
63 | public static void main(String[] args) {
64 | // set up pipeline properties
65 | Properties props = new Properties();
66 | // set the list of annotators to run
67 | props.setProperty("annotators", "tokenize,ssplit,pos");
68 | // build pipeline
69 | StanfordCoreNLP pipeline = new StanfordCoreNLP(props);
70 | // create a document object
71 | CoreDocument document = pipeline.processToCoreDocument(text);
72 | // display tokens
73 | for (CoreLabel tok : document.tokens()) {
74 | System.out.println(String.format("%s\t%s", tok.word(), tok.tag()));
75 | }
76 | }
77 | }
78 | ```
79 |
80 | This demo code will print out the part of speech labels for each token:
81 |
82 | ```
83 | Marie NNP
84 | was VBD
85 | born VBN
86 | in IN
87 | Paris NNP
88 | . .
89 | ```
90 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/content.scss:
--------------------------------------------------------------------------------
1 | @charset "UTF-8";
2 |
3 | //
4 | // Styles for rendered markdown in the .main-content container
5 | //
6 | // stylelint-disable selector-no-type, max-nesting-depth, selector-max-compound-selectors, selector-max-type
7 |
8 | .page-content {
9 | line-height: $content-line-height;
10 |
11 | a {
12 | overflow: hidden;
13 | text-overflow: ellipsis;
14 | white-space: nowrap;
15 | }
16 |
17 | ul,
18 | ol {
19 | padding-left: 1.5em;
20 | }
21 |
22 | ol {
23 | list-style-type: none;
24 | counter-reset: step-counter;
25 |
26 | > li {
27 | position: relative;
28 |
29 | &::before {
30 | position: absolute;
31 | top: 0.2em;
32 | left: -1.6em;
33 | color: $grey-dk-000;
34 | content: counter(step-counter);
35 | counter-increment: step-counter;
36 | @include fs-3;
37 |
38 | @include mq(sm) {
39 | top: 0.11em;
40 | }
41 | }
42 |
43 | ol {
44 | counter-reset: sub-counter;
45 |
46 | li {
47 | &::before {
48 | content: counter(sub-counter, lower-alpha);
49 | counter-increment: sub-counter;
50 | }
51 | }
52 | }
53 | }
54 | }
55 |
56 | ul {
57 | list-style: none;
58 |
59 | > li {
60 | &::before {
61 | position: absolute;
62 | margin-left: -1.4em;
63 | color: $grey-dk-000;
64 | content: "•";
65 | }
66 | }
67 | }
68 |
69 | .task-list {
70 | padding-left: 0;
71 | }
72 |
73 | .task-list-item {
74 | display: flex;
75 | align-items: center;
76 |
77 | &::before {
78 | content: "";
79 | }
80 | }
81 |
82 | .task-list-item-checkbox {
83 | margin-right: 0.6em;
84 | }
85 |
86 | hr + * {
87 | margin-top: 0;
88 | }
89 |
90 | h1:first-of-type {
91 | margin-top: 0.5em;
92 | }
93 |
94 | dl {
95 | display: grid;
96 | grid-template-columns: max-content 1fr;
97 | }
98 |
99 | dt,
100 | dd {
101 | margin: 0.25em 0;
102 | }
103 |
104 | dt {
105 | text-align: right;
106 |
107 | &::after {
108 | content: ":";
109 | }
110 | }
111 |
112 | dd {
113 | margin-left: 1em;
114 | font-weight: 500;
115 | }
116 |
117 | .anchor-heading {
118 | position: absolute;
119 | right: -$sp-4;
120 | width: $sp-5;
121 | height: 100%;
122 | padding-right: $sp-1;
123 | padding-left: $sp-1;
124 | overflow: visible;
125 |
126 | @include mq(md) {
127 | right: auto;
128 | left: -$sp-5;
129 | }
130 |
131 | svg {
132 | display: inline-block;
133 | width: 100%;
134 | height: 100%;
135 | fill: $link-color;
136 | visibility: hidden;
137 | }
138 | }
139 |
140 | .anchor-heading:hover,
141 | h1:hover > .anchor-heading,
142 | h2:hover > .anchor-heading,
143 | h3:hover > .anchor-heading,
144 | h4:hover > .anchor-heading,
145 | h5:hover > .anchor-heading,
146 | h6:hover > .anchor-heading {
147 | svg {
148 | visibility: visible;
149 | }
150 | }
151 |
152 | h1,
153 | h2,
154 | h3,
155 | h4,
156 | h5,
157 | h6 {
158 | position: relative;
159 | }
160 | }
161 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/pipeline.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: Pipeline
4 | keywords: pipeline
5 | permalink: '/pipeline.html'
6 | nav_order: 4
7 | has_children: true
8 | ---
9 |
10 | # Pipeline
11 |
12 | The centerpiece of CoreNLP is the pipeline. Pipelines take in text or xml and generate full annotation objects.
13 |
14 |
15 | 
16 |
3 |
4 |
5 |
6 |
40 |
41 |
42 | {% include custom/conditions.html %}
43 |
44 |
97 | {% else %}
98 |
99 | {% endif %}
100 |
101 | {% endif %}
102 | {% endfor %}
103 | {% endfor %}
104 |
105 |
106 | {% if site.sidebar_accordion == false %}
107 |
112 |
113 |
114 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_sass/support/_variables.scss:
--------------------------------------------------------------------------------
1 | //
2 | // Typography
3 | //
4 |
5 | $body-font-family: -apple-system, BlinkMacSystemFont, "helvetica neue",
6 | helvetica, roboto, noto, "segoe ui", arial, sans-serif !default;
7 | $mono-font-family: "SFMono-Regular", Menlo, Consolas, Monospace !default;
8 | $root-font-size: 16px !default; // Base font-size for rems
9 | $body-line-height: 1.4 !default;
10 | $content-line-height: 1.5 !default;
11 | $body-heading-line-height: 1.15 !default !default;
12 |
13 | //
14 | // Colors
15 | //
16 |
17 | $white: #fff !default;
18 |
19 | $grey-dk-000: #959396 !default;
20 | $grey-dk-100: #5c5962 !default;
21 | $grey-dk-200: #44434d !default;
22 | $grey-dk-250: #302d36 !default;
23 | $grey-dk-300: #27262b !default;
24 |
25 | $grey-lt-000: #f5f6fa !default;
26 | $grey-lt-100: #eeebee !default;
27 | $grey-lt-200: #ecebed !default;
28 | $grey-lt-300: #e6e1e8 !default;
29 |
30 | $purple-000: #7253ed !default;
31 | $purple-100: #5e41d0 !default;
32 | $purple-200: #4e26af !default;
33 | $purple-300: #381885 !default;
34 |
35 | $blue-000: #2c84fa !default;
36 | $blue-100: #2869e6 !default;
37 | $blue-200: #264caf !default;
38 | $blue-300: #183385 !default;
39 |
40 | $green-000: #41d693 !default;
41 | $green-100: #11b584 !default;
42 | $green-200: #009c7b !default;
43 | $green-300: #026e57 !default;
44 |
45 | $yellow-000: #ffeb82 !default;
46 | $yellow-100: #fadf50 !default;
47 | $yellow-200: #f7d12e !default;
48 | $yellow-300: #e7af06 !default;
49 |
50 | $red-000: #f77e7e !default;
51 | $red-100: #f96e65 !default;
52 | $red-200: #e94c4c !default;
53 | $red-300: #dd2e2e !default;
54 |
55 | $body-background-color: $white !default;
56 | $sidebar-color: $grey-lt-000 !default;
57 | $search-background-color: $white !default;
58 | $table-background-color: $white !default;
59 | $code-background-color: $grey-lt-000 !default;
60 |
61 | $body-text-color: $grey-dk-100 !default;
62 | $body-heading-color: $grey-dk-300 !default;
63 | $search-result-preview-color: $grey-dk-000 !default;
64 | $nav-child-link-color: $grey-dk-100 !default;
65 | $link-color: $purple-000 !default;
66 | $btn-primary-color: $purple-100 !default;
67 | $base-button-color: #f7f7f7 !default;
68 |
69 | //
70 | // Spacing
71 | //
72 |
73 | $spacing-unit: 1rem; // 1rem == 16px
74 |
75 | $spacers: (
76 | sp-0: 0,
77 | sp-1: $spacing-unit * 0.25,
78 | sp-2: $spacing-unit * 0.5,
79 | sp-3: $spacing-unit * 0.75,
80 | sp-4: $spacing-unit,
81 | sp-5: $spacing-unit * 1.5,
82 | sp-6: $spacing-unit * 2,
83 | sp-7: $spacing-unit * 2.5,
84 | sp-8: $spacing-unit * 3,
85 | sp-9: $spacing-unit * 3.5,
86 | sp-10: $spacing-unit * 4,
87 | ) !default;
88 |
89 | $sp-1: map-get($spacers, sp-1) !default; // 0.25 rem == 4px
90 | $sp-2: map-get($spacers, sp-2) !default; // 0.5 rem == 8px
91 | $sp-3: map-get($spacers, sp-3) !default; // 0.75 rem == 12px
92 | $sp-4: map-get($spacers, sp-4) !default; // 1 rem == 16px
93 | $sp-5: map-get($spacers, sp-5) !default; // 1.5 rem == 24px
94 | $sp-6: map-get($spacers, sp-6) !default; // 2 rem == 32px
95 | $sp-7: map-get($spacers, sp-7) !default; // 2.5 rem == 40px
96 | $sp-8: map-get($spacers, sp-8) !default; // 3 rem == 48px
97 | $sp-9: map-get($spacers, sp-9) !default; // 4 rem == 48px
98 | $sp-10: map-get($spacers, sp-10) !default; // 4.5 rem == 48px
99 |
100 | //
101 | // Borders
102 | //
103 |
104 | $border: 1px solid !default;
105 | $border-radius: 4px !default;
106 | $border-color: $grey-lt-100 !default;
107 |
108 | //
109 | // Grid system
110 | //
111 |
112 | $gutter-spacing: $sp-6 !default;
113 | $gutter-spacing-sm: $sp-4 !default;
114 | $nav-width: 264px !default;
115 | $nav-width-md: 248px !default;
116 | $content-width: 800px !default;
117 | $header-height: 60px !default;
118 | $search-results-width: 500px !default;
119 |
120 | //
121 | // Media queries in pixels
122 | //
123 |
124 | $media-queries: (
125 | xs: 320px,
126 | sm: 500px,
127 | md: $content-width,
128 | lg: $content-width + $nav-width,
129 | xl: 1400px,
130 | ) !default;
131 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_pages/truecase.md:
--------------------------------------------------------------------------------
1 | ---
2 | layout: page
3 | title: TrueCaseAnnotator
4 | keywords: truecase
5 | permalink: '/truecase.html'
6 | nav_order: 7
7 | parent: Full List Of Annotators
8 | ---
9 |
10 | ## Description
11 |
12 | Recognizes the “true” case of tokens (how it would be capitalized in
13 | well-edited text) where this information was
14 | lost, e.g., all upper case text. This is implemented with a
15 | discriminative model using the CRF sequence tagger. A true
16 | case category label, e.g., INIT_UPPER for each word is saved in `TrueCaseAnnotation`. The token
17 | text adjusted to match its true case is saved under the
18 | `TrueCaseTextAnnotation`. There is an option to also overwrite the
19 | TextAnnotation of the token, which will change the behavior of later
20 | annotators (they will use the truecased text): `truecase.overwriteText`. The original text
21 | prior to any normalization can still be retrieved from the
22 | `OriginalTextAnnotation`. (The JSON output format is a text output format that
23 | contains these annotations.) At present, we only have a trained
24 | `truecase` model for English, but models could be trained for other languages.
25 |
26 | Use of the `truecase` annotator is one of two good ways of dealing
27 | with texts that mostly or entirely lack case distinctions. The other
28 | is to use [caseless models](caseless.html).
29 |
30 | | Property name | Annotator class name | Generated Annotation |
31 | | --- | --- | --- |
32 | | truecase | TrueCaseAnnotator | TrueCaseAnnotation and TrueCaseTextAnnotation |
33 |
34 | ## Options
35 |
36 | | Option name | Type | Default | Description |
37 | | --- | --- | --- | --- |
38 | | truecase.model | String | edu/stanford/nlp/models/truecase/truecasing.fast.caseless.qn.ser.gz | The truecasing model to use. |
39 | | truecase.bias | String | INIT\_UPPER:-0.7,UPPER:-0.7,O:0 | Biases to choose certain behaviors. You can use this to adjust the proclivities of the truecaser. The truecaser classes are: UPPER, LOWER, INIT\_UPPER, and O (for mixed case words like _McVey_). |
40 | | truecase.mixedcasefile | String | edu/stanford/nlp/models/truecase/MixDisambiguation.list | When the classifier chooses mixed case classification, the form in this file (if any) is used, otherwise the input token is left unchanged. |
41 | | truecase.overwriteText | boolean | false | Whether the truecased token form should be used to overwrite the TextAnnotation, affecting the behavior of later annotators in a pipeline. |
42 | | truecase.verbose | boolean | false | Whether to run more verbosely. |
43 |
44 | ## Example
45 |
46 | To use the `truecase` model to work with uncased text, place it after
47 | sentence splitting but before other annotators that use case
48 | information. Here is an example:
49 |
50 | % cat lakers.txt
51 | lonzo ball talked about kobe bryant after the lakers game.
52 |
53 | With the default English models, no entities (and no proper nouns) are
54 | found:
55 |
56 | % java edu.stanford.nlp.pipeline.StanfordCoreNLP -file lakers.txt -outputFormat conll -annotators tokenize,ssplit,pos,lemma,ner
57 | % cat lakers.txt.conll
58 | 1 lonzo lonzo NN O _ _
59 | 2 ball ball NN O _ _
60 | 3 talked talk VBD O _ _
61 | 4 about about IN O _ _
62 | 5 kobe kobe NN O _ _
63 | 6 bryant bryant NN O _ _
64 | 7 after after IN O _ _
65 | 8 the the DT O _ _
66 | 9 lakers laker NNS O _ _
67 | 10 game game NN O _ _
68 | 11 . . . O _ _
69 |
70 | However, Instead, if we run truecasing prior to POS tagging and NER,
71 | then we get:
72 |
73 | % java edu.stanford.nlp.pipeline.StanfordCoreNLP -outputFormat conll -annotators tokenize,ssplit,truecase,pos,lemma,ner -file lakers.txt -truecase.overwriteText
74 | % cat lakers.txt.conll
75 | 1 Lonzo Lonzo NNP PERSON _ _
76 | 2 ball ball NN O _ _
77 | 3 talked talk VBD O _ _
78 | 4 about about IN O _ _
79 | 5 Kobe Kobe NNP PERSON _ _
80 | 6 Bryant Bryant NNP PERSON _ _
81 | 7 after after IN O _ _
82 | 8 the the DT O _ _
83 | 9 Lakers Lakers NNPS ORGANIZATION _ _
84 | 10 game game NN O _ _
85 | 11 . . . O _ _
86 |
87 | Now, the organization *Lakers* is recognized, and in general nearly
88 | all the entity words are tagged as proper nouns with the correct
89 | entity label. However, the model fails to get *ball*, which remains a common noun. Of course, this is a fairly hard word to get right in caseless text, since *ball* is a quite frequent common noun.
90 |
--------------------------------------------------------------------------------
/CoreNLP-gh-pages/_includes/topnav.html:
--------------------------------------------------------------------------------
1 |
2 | 108 | Collapse All | Expand All 109 |
110 | {% endif %} 111 |