├── README.md ├── configs ├── word.pos.chunk.yml └── word.yml ├── data ├── test.bieso.txt ├── train.bieso.txt └── valid.bieso.txt ├── main.py ├── requirements.txt ├── run.sh ├── sltk ├── __init__.py ├── data │ ├── __init__.py │ └── dataset.py ├── infer │ ├── __init__.py │ └── inference.py ├── metrics │ └── __init__.py ├── nn │ ├── __init__.py │ ├── functional │ │ ├── __init__.py │ │ └── initialize.py │ └── modules │ │ ├── __init__.py │ │ ├── crf.py │ │ ├── feature.py │ │ ├── rnn.py │ │ └── sequence_labeling_model.py ├── preprocessing │ ├── __init__.py │ └── normalize.py ├── train │ ├── __init__.py │ └── sequence_labeling_trainer.py └── utils │ ├── __init__.py │ ├── conllu.py │ ├── embedding.py │ ├── general.py │ └── io.py ├── test ├── test_dataset.py └── test_yml.py └── tools ├── README.md ├── bio2bieo.py └── conlleval /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/README.md -------------------------------------------------------------------------------- /configs/word.pos.chunk.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/configs/word.pos.chunk.yml -------------------------------------------------------------------------------- /configs/word.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/configs/word.yml -------------------------------------------------------------------------------- /data/test.bieso.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/data/test.bieso.txt -------------------------------------------------------------------------------- /data/train.bieso.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/data/train.bieso.txt -------------------------------------------------------------------------------- /data/valid.bieso.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/data/valid.bieso.txt -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/main.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | gensim 2 | h5py 3 | numpy 4 | torch==0.4.0 5 | pyyaml -------------------------------------------------------------------------------- /run.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/run.sh -------------------------------------------------------------------------------- /sltk/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /sltk/data/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/data/__init__.py -------------------------------------------------------------------------------- /sltk/data/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/data/dataset.py -------------------------------------------------------------------------------- /sltk/infer/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/infer/__init__.py -------------------------------------------------------------------------------- /sltk/infer/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/infer/inference.py -------------------------------------------------------------------------------- /sltk/metrics/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /sltk/nn/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /sltk/nn/functional/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/functional/__init__.py -------------------------------------------------------------------------------- /sltk/nn/functional/initialize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/functional/initialize.py -------------------------------------------------------------------------------- /sltk/nn/modules/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/modules/__init__.py -------------------------------------------------------------------------------- /sltk/nn/modules/crf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/modules/crf.py -------------------------------------------------------------------------------- /sltk/nn/modules/feature.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/modules/feature.py -------------------------------------------------------------------------------- /sltk/nn/modules/rnn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/modules/rnn.py -------------------------------------------------------------------------------- /sltk/nn/modules/sequence_labeling_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/nn/modules/sequence_labeling_model.py -------------------------------------------------------------------------------- /sltk/preprocessing/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/preprocessing/__init__.py -------------------------------------------------------------------------------- /sltk/preprocessing/normalize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/preprocessing/normalize.py -------------------------------------------------------------------------------- /sltk/train/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/train/__init__.py -------------------------------------------------------------------------------- /sltk/train/sequence_labeling_trainer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/train/sequence_labeling_trainer.py -------------------------------------------------------------------------------- /sltk/utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/utils/__init__.py -------------------------------------------------------------------------------- /sltk/utils/conllu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/utils/conllu.py -------------------------------------------------------------------------------- /sltk/utils/embedding.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/utils/embedding.py -------------------------------------------------------------------------------- /sltk/utils/general.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/utils/general.py -------------------------------------------------------------------------------- /sltk/utils/io.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/sltk/utils/io.py -------------------------------------------------------------------------------- /test/test_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/test/test_dataset.py -------------------------------------------------------------------------------- /test/test_yml.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/test/test_yml.py -------------------------------------------------------------------------------- /tools/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/tools/README.md -------------------------------------------------------------------------------- /tools/bio2bieo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/tools/bio2bieo.py -------------------------------------------------------------------------------- /tools/conlleval: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/liu-nlper/SLTK/HEAD/tools/conlleval --------------------------------------------------------------------------------