├── .gitignore ├── LICENSE ├── README.md ├── evaluation ├── README.md ├── eval.py ├── eval_scripts_askapatient_10cv.sh ├── eval_scripts_cometa.sh ├── eval_scripts_ncbi_bc5cdr.sh ├── eval_scripts_xlbel_test.sh ├── utils.py └── xl_bel │ ├── umls_onto_all_lang_cased_wikimed_only_399931.txt │ ├── xlbel_v0.0 │ ├── all_1k_test_query.txt │ ├── de_1k_test_query.txt │ ├── en_1k_test_query.txt │ ├── es_1k_test_query.txt │ ├── fi_1k_test_query.txt │ ├── ja_1k_test_query.txt │ ├── ko_1k_test_query.txt │ ├── ru_1k_test_query.txt │ ├── th_1k_test_query.txt │ ├── tr_1k_test_query.txt │ └── zh_1k_test_query.txt │ └── xlbel_v1.0 │ ├── all_1k_test_query_with_context.txt │ ├── de_1k_test_query_with_context.txt │ ├── en_1k_test_query_with_context.txt │ ├── es_1k_test_query_with_context.txt │ ├── fi_1k_test_query_with_context.txt │ ├── ja_1k_test_query_with_context.txt │ ├── ko_1k_test_query_with_context.txt │ ├── ru_1k_test_query_with_context.txt │ ├── th_1k_test_query_with_context.txt │ ├── tr_1k_test_query_with_context.txt │ └── zh_1k_test_query_with_context.txt ├── inference ├── Snomed.py └── inference_on_snomed.ipynb ├── misc ├── sapbert_front_graphs_v6.pdf └── sapbert_front_graphs_v6.png ├── requirements.txt ├── src ├── __init__.py ├── data_loader.py ├── metric_learning.py └── model_wrapper.py ├── train ├── .gitignore ├── pretrain.sh ├── train.py └── xling_train.sh └── training_data ├── README.md └── generate_pretraining_data.ipynb /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/README.md -------------------------------------------------------------------------------- /evaluation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/README.md -------------------------------------------------------------------------------- /evaluation/eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/eval.py -------------------------------------------------------------------------------- /evaluation/eval_scripts_askapatient_10cv.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/eval_scripts_askapatient_10cv.sh -------------------------------------------------------------------------------- /evaluation/eval_scripts_cometa.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/eval_scripts_cometa.sh -------------------------------------------------------------------------------- /evaluation/eval_scripts_ncbi_bc5cdr.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/eval_scripts_ncbi_bc5cdr.sh -------------------------------------------------------------------------------- /evaluation/eval_scripts_xlbel_test.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/eval_scripts_xlbel_test.sh -------------------------------------------------------------------------------- /evaluation/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/utils.py -------------------------------------------------------------------------------- /evaluation/xl_bel/umls_onto_all_lang_cased_wikimed_only_399931.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/umls_onto_all_lang_cased_wikimed_only_399931.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/all_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/all_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/de_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/de_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/en_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/en_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/es_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/es_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/fi_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/fi_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/ja_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/ja_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/ko_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/ko_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/ru_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/ru_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/th_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/th_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/tr_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/tr_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v0.0/zh_1k_test_query.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v0.0/zh_1k_test_query.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/all_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/all_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/de_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/de_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/en_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/en_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/es_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/es_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/fi_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/fi_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/ja_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/ja_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/ko_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/ko_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/ru_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/ru_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/th_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/th_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/tr_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/tr_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /evaluation/xl_bel/xlbel_v1.0/zh_1k_test_query_with_context.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/evaluation/xl_bel/xlbel_v1.0/zh_1k_test_query_with_context.txt -------------------------------------------------------------------------------- /inference/Snomed.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/inference/Snomed.py -------------------------------------------------------------------------------- /inference/inference_on_snomed.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/inference/inference_on_snomed.ipynb -------------------------------------------------------------------------------- /misc/sapbert_front_graphs_v6.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/misc/sapbert_front_graphs_v6.pdf -------------------------------------------------------------------------------- /misc/sapbert_front_graphs_v6.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/misc/sapbert_front_graphs_v6.png -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/requirements.txt -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/src/__init__.py -------------------------------------------------------------------------------- /src/data_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/src/data_loader.py -------------------------------------------------------------------------------- /src/metric_learning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/src/metric_learning.py -------------------------------------------------------------------------------- /src/model_wrapper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/src/model_wrapper.py -------------------------------------------------------------------------------- /train/.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/train/.gitignore -------------------------------------------------------------------------------- /train/pretrain.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/train/pretrain.sh -------------------------------------------------------------------------------- /train/train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/train/train.py -------------------------------------------------------------------------------- /train/xling_train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/train/xling_train.sh -------------------------------------------------------------------------------- /training_data/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/training_data/README.md -------------------------------------------------------------------------------- /training_data/generate_pretraining_data.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/cambridgeltl/sapbert/HEAD/training_data/generate_pretraining_data.ipynb --------------------------------------------------------------------------------