├── LICENSE ├── README.md ├── data ├── conll │ ├── AnEM_train.conll │ ├── BioRED_TrainDev-ALL.conll │ └── Merged_All-AIO.conll ├── list_train.txt └── pubtator │ ├── BC5CDR_Test.PubTator │ ├── BC5CDR_TrainDev.PubTator │ ├── BioID_Test_revision.PubTator │ ├── BioID_Train_revision.PubTator │ ├── BioRED_Test.PubTator │ ├── BioRED_TrainDev.PubTator │ ├── DrugProt_Test.PubTator │ ├── DrugProt_Train.PubTator │ ├── GNormPlus_Test.PubTator │ ├── GNormPlus_Train.PubTator │ ├── Linnaeus_Test.PubTator │ ├── Linnaeus_Train.PubTator │ ├── NCBIdisease_Test.PubTator │ ├── NCBIdisease_TrainDev.PubTator │ ├── NLMchem_Test.PubTator │ ├── NLMchem_TrainDev.PubTator │ ├── NLMgene_Test.PubTator │ ├── NLMgene_Train.PubTator │ ├── SPECIES_Test.PubTator │ ├── SPECIES_Train.PubTator │ ├── tmVar3_Test.PubTator │ └── tmVar3_Train.PubTator ├── example └── input │ ├── ex1 │ └── ex2 ├── requirements.txt ├── src ├── AIONER_FineTune.py ├── AIONER_Run.py ├── AIONER_Training.py ├── Format_Preprocess.py ├── Test_Evaluation.py ├── evaluation_BIO.py ├── finetune_model_ner.py ├── model_ner.py ├── processing_data.py ├── represent_ner.py ├── restore_index.py └── tf_crf2.py └── vocab ├── AIO_label.vocab └── AnEM_label.vocab /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/README.md -------------------------------------------------------------------------------- /data/conll/AnEM_train.conll: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/conll/AnEM_train.conll -------------------------------------------------------------------------------- /data/conll/BioRED_TrainDev-ALL.conll: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/conll/BioRED_TrainDev-ALL.conll -------------------------------------------------------------------------------- /data/conll/Merged_All-AIO.conll: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/conll/Merged_All-AIO.conll -------------------------------------------------------------------------------- /data/list_train.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/list_train.txt -------------------------------------------------------------------------------- /data/pubtator/BC5CDR_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/BC5CDR_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/BC5CDR_TrainDev.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/BC5CDR_TrainDev.PubTator -------------------------------------------------------------------------------- /data/pubtator/BioID_Test_revision.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/BioID_Test_revision.PubTator -------------------------------------------------------------------------------- /data/pubtator/BioID_Train_revision.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/BioID_Train_revision.PubTator -------------------------------------------------------------------------------- /data/pubtator/BioRED_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/BioRED_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/BioRED_TrainDev.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/BioRED_TrainDev.PubTator -------------------------------------------------------------------------------- /data/pubtator/DrugProt_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/DrugProt_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/DrugProt_Train.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/DrugProt_Train.PubTator -------------------------------------------------------------------------------- /data/pubtator/GNormPlus_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/GNormPlus_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/GNormPlus_Train.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/GNormPlus_Train.PubTator -------------------------------------------------------------------------------- /data/pubtator/Linnaeus_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/Linnaeus_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/Linnaeus_Train.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/Linnaeus_Train.PubTator -------------------------------------------------------------------------------- /data/pubtator/NCBIdisease_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/NCBIdisease_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/NCBIdisease_TrainDev.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/NCBIdisease_TrainDev.PubTator -------------------------------------------------------------------------------- /data/pubtator/NLMchem_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/NLMchem_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/NLMchem_TrainDev.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/NLMchem_TrainDev.PubTator -------------------------------------------------------------------------------- /data/pubtator/NLMgene_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/NLMgene_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/NLMgene_Train.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/NLMgene_Train.PubTator -------------------------------------------------------------------------------- /data/pubtator/SPECIES_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/SPECIES_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/SPECIES_Train.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/SPECIES_Train.PubTator -------------------------------------------------------------------------------- /data/pubtator/tmVar3_Test.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/tmVar3_Test.PubTator -------------------------------------------------------------------------------- /data/pubtator/tmVar3_Train.PubTator: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/data/pubtator/tmVar3_Train.PubTator -------------------------------------------------------------------------------- /example/input/ex1: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/example/input/ex1 -------------------------------------------------------------------------------- /example/input/ex2: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/example/input/ex2 -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/requirements.txt -------------------------------------------------------------------------------- /src/AIONER_FineTune.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/AIONER_FineTune.py -------------------------------------------------------------------------------- /src/AIONER_Run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/AIONER_Run.py -------------------------------------------------------------------------------- /src/AIONER_Training.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/AIONER_Training.py -------------------------------------------------------------------------------- /src/Format_Preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/Format_Preprocess.py -------------------------------------------------------------------------------- /src/Test_Evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/Test_Evaluation.py -------------------------------------------------------------------------------- /src/evaluation_BIO.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/evaluation_BIO.py -------------------------------------------------------------------------------- /src/finetune_model_ner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/finetune_model_ner.py -------------------------------------------------------------------------------- /src/model_ner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/model_ner.py -------------------------------------------------------------------------------- /src/processing_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/processing_data.py -------------------------------------------------------------------------------- /src/represent_ner.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/represent_ner.py -------------------------------------------------------------------------------- /src/restore_index.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/restore_index.py -------------------------------------------------------------------------------- /src/tf_crf2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/src/tf_crf2.py -------------------------------------------------------------------------------- /vocab/AIO_label.vocab: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/vocab/AIO_label.vocab -------------------------------------------------------------------------------- /vocab/AnEM_label.vocab: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ncbi/AIONER/HEAD/vocab/AnEM_label.vocab --------------------------------------------------------------------------------