├── .dockerignore ├── .gitignore ├── LICENSE ├── README.md ├── config └── ruMorpheme.json ├── data ├── .gitignore ├── dostoevsky.csv ├── test_Tikhonov_reformat.txt └── train_Tikhonov_reformat.txt ├── eval.py ├── input_text.txt ├── parse.py ├── predict.py ├── predict_file.py ├── read.py ├── requirements-dataset.txt ├── requirements-dev.txt ├── requirements-tokenizer.txt ├── requirements.txt ├── rumorpheme ├── __init__.py ├── const.py ├── model.py ├── tokenizer.py └── utils │ ├── __init__.py │ ├── labels_to_morphemes.py │ └── prepare_data.py ├── setup.py ├── tokenizer_build.py ├── tokenizer_dataset.py ├── tokenizer_test.py └── train.py /.dockerignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/.dockerignore -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/README.md -------------------------------------------------------------------------------- /config/ruMorpheme.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/config/ruMorpheme.json -------------------------------------------------------------------------------- /data/.gitignore: -------------------------------------------------------------------------------- 1 | all_text.txt 2 | -------------------------------------------------------------------------------- /data/dostoevsky.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/data/dostoevsky.csv -------------------------------------------------------------------------------- /data/test_Tikhonov_reformat.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/data/test_Tikhonov_reformat.txt -------------------------------------------------------------------------------- /data/train_Tikhonov_reformat.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/data/train_Tikhonov_reformat.txt -------------------------------------------------------------------------------- /eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/eval.py -------------------------------------------------------------------------------- /input_text.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/input_text.txt -------------------------------------------------------------------------------- /parse.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/parse.py -------------------------------------------------------------------------------- /predict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/predict.py -------------------------------------------------------------------------------- /predict_file.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/predict_file.py -------------------------------------------------------------------------------- /read.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/read.py -------------------------------------------------------------------------------- /requirements-dataset.txt: -------------------------------------------------------------------------------- 1 | requests 2 | beautifulsoup4 3 | datasets 4 | -------------------------------------------------------------------------------- /requirements-dev.txt: -------------------------------------------------------------------------------- 1 | setuptools 2 | wheel 3 | twine 4 | -------------------------------------------------------------------------------- /requirements-tokenizer.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/requirements-tokenizer.txt -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/requirements.txt -------------------------------------------------------------------------------- /rumorpheme/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/__init__.py -------------------------------------------------------------------------------- /rumorpheme/const.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/const.py -------------------------------------------------------------------------------- /rumorpheme/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/model.py -------------------------------------------------------------------------------- /rumorpheme/tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/tokenizer.py -------------------------------------------------------------------------------- /rumorpheme/utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/utils/__init__.py -------------------------------------------------------------------------------- /rumorpheme/utils/labels_to_morphemes.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/utils/labels_to_morphemes.py -------------------------------------------------------------------------------- /rumorpheme/utils/prepare_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/rumorpheme/utils/prepare_data.py -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/setup.py -------------------------------------------------------------------------------- /tokenizer_build.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/tokenizer_build.py -------------------------------------------------------------------------------- /tokenizer_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/tokenizer_dataset.py -------------------------------------------------------------------------------- /tokenizer_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/tokenizer_test.py -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/EvilFreelancer/ruMorpheme/HEAD/train.py --------------------------------------------------------------------------------