├── .gitignore ├── LICENSE ├── README.md ├── evi_gen ├── README.md ├── requirements.txt ├── setup.py ├── src │ ├── data.py │ ├── evaluation.py │ ├── model.py │ ├── options.py │ ├── preprocess.py │ ├── slurm.py │ └── util.py ├── test_classifier.py ├── test_reader.py ├── train_classifier.py └── train_reader.py ├── mining ├── README.md ├── requirements.txt ├── run_ranker.py └── scripts │ ├── convert_dpr_to_ranker_data.py │ ├── create_evidentiality_training.py │ ├── create_leave_one_out_data.py │ ├── create_train_data_from_hold_out.py │ ├── create_train_data_from_hold_out_fever.py │ └── create_train_data_from_hold_out_wow.py └── overview_figure_final.jpg /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/README.md -------------------------------------------------------------------------------- /evi_gen/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/README.md -------------------------------------------------------------------------------- /evi_gen/requirements.txt: -------------------------------------------------------------------------------- 1 | numpy 2 | torch 3 | faiss-cpu 4 | transformers==3.0.2 5 | tensorboard 6 | -------------------------------------------------------------------------------- /evi_gen/setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/setup.py -------------------------------------------------------------------------------- /evi_gen/src/data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/data.py -------------------------------------------------------------------------------- /evi_gen/src/evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/evaluation.py -------------------------------------------------------------------------------- /evi_gen/src/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/model.py -------------------------------------------------------------------------------- /evi_gen/src/options.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/options.py -------------------------------------------------------------------------------- /evi_gen/src/preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/preprocess.py -------------------------------------------------------------------------------- /evi_gen/src/slurm.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/slurm.py -------------------------------------------------------------------------------- /evi_gen/src/util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/src/util.py -------------------------------------------------------------------------------- /evi_gen/test_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/test_classifier.py -------------------------------------------------------------------------------- /evi_gen/test_reader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/test_reader.py -------------------------------------------------------------------------------- /evi_gen/train_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/train_classifier.py -------------------------------------------------------------------------------- /evi_gen/train_reader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/evi_gen/train_reader.py -------------------------------------------------------------------------------- /mining/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/README.md -------------------------------------------------------------------------------- /mining/requirements.txt: -------------------------------------------------------------------------------- 1 | transformers==4.2.1 2 | -------------------------------------------------------------------------------- /mining/run_ranker.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/run_ranker.py -------------------------------------------------------------------------------- /mining/scripts/convert_dpr_to_ranker_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/scripts/convert_dpr_to_ranker_data.py -------------------------------------------------------------------------------- /mining/scripts/create_evidentiality_training.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/scripts/create_evidentiality_training.py -------------------------------------------------------------------------------- /mining/scripts/create_leave_one_out_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/scripts/create_leave_one_out_data.py -------------------------------------------------------------------------------- /mining/scripts/create_train_data_from_hold_out.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/scripts/create_train_data_from_hold_out.py -------------------------------------------------------------------------------- /mining/scripts/create_train_data_from_hold_out_fever.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/scripts/create_train_data_from_hold_out_fever.py -------------------------------------------------------------------------------- /mining/scripts/create_train_data_from_hold_out_wow.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/mining/scripts/create_train_data_from_hold_out_wow.py -------------------------------------------------------------------------------- /overview_figure_final.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/AkariAsai/evidentiality_qa/HEAD/overview_figure_final.jpg --------------------------------------------------------------------------------