├── README.md ├── bert_downstream ├── README.md ├── bert_master │ └── README.md ├── data_path │ └── README.md ├── model_ckpt │ └── README.md ├── pre_trained │ └── README.md ├── train_classifier.py ├── train_multi_learning.py └── train_ner.py ├── ckbqa ├── DUTIR中文开放域知识问答评测报告.pdf ├── README.md └── 基于特征融合的中文知识库问答方法.pdf ├── named_entity_recognition ├── README.md ├── convert_bio.py ├── data_path │ └── README.md ├── data_utils │ ├── __init__.py │ └── datasets.py ├── inference.py ├── model_ckpt │ └── README.md ├── model_pb │ └── README.md ├── models │ ├── __init__.py │ └── bilstm_crf.py ├── ner_main.py ├── pics │ ├── 命名实体识别数据图.png │ └── 命名实体识别的模型总结图.png └── preprocess.py └── text_classification ├── README.md ├── data_path ├── README.md ├── tnews_data.pkl └── vocab.txt ├── inference.py ├── model_ckpt └── README.md ├── model_pb └── README.md ├── models ├── __init__.py ├── attention.py ├── base_model.py ├── bilstm_model.py ├── ffnn_model.py ├── model_utils.py └── text_cnn.py ├── preprocess.py ├── tf_metrics.py ├── tnews_data_eda.ipynb └── train_main.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/README.md -------------------------------------------------------------------------------- /bert_downstream/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/bert_downstream/README.md -------------------------------------------------------------------------------- /bert_downstream/bert_master/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/bert_downstream/bert_master/README.md -------------------------------------------------------------------------------- /bert_downstream/data_path/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里存放的是数据集 -------------------------------------------------------------------------------- /bert_downstream/model_ckpt/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里保存训练后的checkpoint文件 -------------------------------------------------------------------------------- /bert_downstream/pre_trained/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里存放的是预训练模型，本项目主要使用的是哈工大讯飞实验室的bert模型，地址见：https://github.com/ymcui/Chinese-BERT-wwm -------------------------------------------------------------------------------- /bert_downstream/train_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/bert_downstream/train_classifier.py -------------------------------------------------------------------------------- /bert_downstream/train_multi_learning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/bert_downstream/train_multi_learning.py -------------------------------------------------------------------------------- /bert_downstream/train_ner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/bert_downstream/train_ner.py -------------------------------------------------------------------------------- /ckbqa/DUTIR中文开放域知识问答评测报告.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/ckbqa/DUTIR中文开放域知识问答评测报告.pdf -------------------------------------------------------------------------------- /ckbqa/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/ckbqa/README.md -------------------------------------------------------------------------------- /ckbqa/基于特征融合的中文知识库问答方法.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/ckbqa/基于特征融合的中文知识库问答方法.pdf -------------------------------------------------------------------------------- /named_entity_recognition/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/README.md -------------------------------------------------------------------------------- /named_entity_recognition/convert_bio.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/convert_bio.py -------------------------------------------------------------------------------- /named_entity_recognition/data_path/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里存放的是数据集 -------------------------------------------------------------------------------- /named_entity_recognition/data_utils/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/data_utils/__init__.py -------------------------------------------------------------------------------- /named_entity_recognition/data_utils/datasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/data_utils/datasets.py -------------------------------------------------------------------------------- /named_entity_recognition/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/inference.py -------------------------------------------------------------------------------- /named_entity_recognition/model_ckpt/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里保存训练后的checkpoint文件 -------------------------------------------------------------------------------- /named_entity_recognition/model_pb/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里保存训练后的pb模型文件 -------------------------------------------------------------------------------- /named_entity_recognition/models/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/models/__init__.py -------------------------------------------------------------------------------- /named_entity_recognition/models/bilstm_crf.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/models/bilstm_crf.py -------------------------------------------------------------------------------- /named_entity_recognition/ner_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/ner_main.py -------------------------------------------------------------------------------- /named_entity_recognition/pics/命名实体识别数据图.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/pics/命名实体识别数据图.png -------------------------------------------------------------------------------- /named_entity_recognition/pics/命名实体识别的模型总结图.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/pics/命名实体识别的模型总结图.png -------------------------------------------------------------------------------- /named_entity_recognition/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/named_entity_recognition/preprocess.py -------------------------------------------------------------------------------- /text_classification/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/README.md -------------------------------------------------------------------------------- /text_classification/data_path/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里存放的是数据集 -------------------------------------------------------------------------------- /text_classification/data_path/tnews_data.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/data_path/tnews_data.pkl -------------------------------------------------------------------------------- /text_classification/data_path/vocab.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/data_path/vocab.txt -------------------------------------------------------------------------------- /text_classification/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/inference.py -------------------------------------------------------------------------------- /text_classification/model_ckpt/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里保存训练后的checkpoint文件 -------------------------------------------------------------------------------- /text_classification/model_pb/README.md: -------------------------------------------------------------------------------- 1 | ### 文件说明 2 | 3 | 这里保存训练后的pb模型文件 -------------------------------------------------------------------------------- /text_classification/models/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/__init__.py -------------------------------------------------------------------------------- /text_classification/models/attention.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/attention.py -------------------------------------------------------------------------------- /text_classification/models/base_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/base_model.py -------------------------------------------------------------------------------- /text_classification/models/bilstm_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/bilstm_model.py -------------------------------------------------------------------------------- /text_classification/models/ffnn_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/ffnn_model.py -------------------------------------------------------------------------------- /text_classification/models/model_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/model_utils.py -------------------------------------------------------------------------------- /text_classification/models/text_cnn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/models/text_cnn.py -------------------------------------------------------------------------------- /text_classification/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/preprocess.py -------------------------------------------------------------------------------- /text_classification/tf_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/tf_metrics.py -------------------------------------------------------------------------------- /text_classification/tnews_data_eda.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/tnews_data_eda.ipynb -------------------------------------------------------------------------------- /text_classification/train_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/xudongMk/AwesomeNLPBaseline/HEAD/text_classification/train_main.py --------------------------------------------------------------------------------