├── .gitignore ├── LICENSE ├── README.md ├── allennlp_lib ├── __init__.py ├── data │ ├── __init__.py │ ├── data_loaders │ │ └── __init__.py │ └── dataset_readers │ │ └── __init__.py ├── models │ └── __init__.py ├── nn │ └── __init__.py ├── predictors │ └── __init__.py ├── tools │ ├── __init__.py │ ├── drop.py │ └── squad.py └── training │ ├── __init__.py │ └── metrics │ └── list_squad_em_and_f1.py ├── constants.py ├── digit_tokenization.py ├── download_processed_target_datasets.sh ├── download_raw_target_datasets.sh ├── download_teabreac_data.sh ├── evaluate.py ├── evaluate_all.py ├── lib.py ├── official_evaluation_scripts ├── drop_eval.py ├── tatqa_eval.py ├── tatqa_metric.py └── tatqa_utils.py ├── predict.py ├── predict_all.py ├── predictions_to_official_format.py ├── processing_scripts ├── preprocess_drop.py ├── preprocess_drop_bpb.py ├── preprocess_drop_cs.py ├── preprocess_iirc_gold.py ├── preprocess_iirc_retrieved.py ├── preprocess_numglue.py └── preprocess_tatqa.py ├── requirements ├── evaluate.txt ├── predict.txt ├── preprocess.txt └── summarize.txt ├── results_report.txt ├── summarize_results.py ├── teabreac.pdf └── teabreac_icon.png /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/README.md -------------------------------------------------------------------------------- /allennlp_lib/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/data/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/data/data_loaders/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/data/dataset_readers/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/models/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/nn/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/predictors/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/tools/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/tools/drop.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/allennlp_lib/tools/drop.py -------------------------------------------------------------------------------- /allennlp_lib/tools/squad.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/allennlp_lib/tools/squad.py -------------------------------------------------------------------------------- /allennlp_lib/training/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /allennlp_lib/training/metrics/list_squad_em_and_f1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/allennlp_lib/training/metrics/list_squad_em_and_f1.py -------------------------------------------------------------------------------- /constants.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/constants.py -------------------------------------------------------------------------------- /digit_tokenization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/digit_tokenization.py -------------------------------------------------------------------------------- /download_processed_target_datasets.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/download_processed_target_datasets.sh -------------------------------------------------------------------------------- /download_raw_target_datasets.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/download_raw_target_datasets.sh -------------------------------------------------------------------------------- /download_teabreac_data.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/download_teabreac_data.sh -------------------------------------------------------------------------------- /evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/evaluate.py -------------------------------------------------------------------------------- /evaluate_all.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/evaluate_all.py -------------------------------------------------------------------------------- /lib.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/lib.py -------------------------------------------------------------------------------- /official_evaluation_scripts/drop_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/official_evaluation_scripts/drop_eval.py -------------------------------------------------------------------------------- /official_evaluation_scripts/tatqa_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/official_evaluation_scripts/tatqa_eval.py -------------------------------------------------------------------------------- /official_evaluation_scripts/tatqa_metric.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/official_evaluation_scripts/tatqa_metric.py -------------------------------------------------------------------------------- /official_evaluation_scripts/tatqa_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/official_evaluation_scripts/tatqa_utils.py -------------------------------------------------------------------------------- /predict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/predict.py -------------------------------------------------------------------------------- /predict_all.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/predict_all.py -------------------------------------------------------------------------------- /predictions_to_official_format.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/predictions_to_official_format.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_drop.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_drop.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_drop_bpb.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_drop_bpb.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_drop_cs.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_drop_cs.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_iirc_gold.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_iirc_gold.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_iirc_retrieved.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_iirc_retrieved.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_numglue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_numglue.py -------------------------------------------------------------------------------- /processing_scripts/preprocess_tatqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/processing_scripts/preprocess_tatqa.py -------------------------------------------------------------------------------- /requirements/evaluate.txt: -------------------------------------------------------------------------------- 1 | base58 2 | dill 3 | tqdm 4 | allennlp==2.7.0 -------------------------------------------------------------------------------- /requirements/predict.txt: -------------------------------------------------------------------------------- 1 | base58 2 | dill 3 | tqdm 4 | transformers==4.24.0 5 | torch==1.12.1 6 | sentencepiece -------------------------------------------------------------------------------- /requirements/preprocess.txt: -------------------------------------------------------------------------------- 1 | base58 2 | dill 3 | tqdm 4 | scikit-learn -------------------------------------------------------------------------------- /requirements/summarize.txt: -------------------------------------------------------------------------------- 1 | pandas 2 | -------------------------------------------------------------------------------- /results_report.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/results_report.txt -------------------------------------------------------------------------------- /summarize_results.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/summarize_results.py -------------------------------------------------------------------------------- /teabreac.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/teabreac.pdf -------------------------------------------------------------------------------- /teabreac_icon.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/StonyBrookNLP/teabreac/HEAD/teabreac_icon.png --------------------------------------------------------------------------------