├── LICENSE ├── README.md ├── alternative_objectives └── README.md ├── human_experiments ├── README.md ├── expert_analysis.Rmd └── ratings_analysis.Rmd ├── requirements.txt ├── rl_experiments ├── README.md ├── data │ ├── cqa │ │ ├── dev.csv │ │ ├── test.csv │ │ └── train.csv │ ├── e-snli │ │ ├── dev.tsv │ │ ├── test.tsv │ │ └── train.tsv │ └── sm │ │ ├── dataset.jsonl │ │ ├── eval.jsonl │ │ └── train.jsonl ├── models │ └── T5ForMC.py ├── run_cqa_t5_rl_ra.sh ├── run_cqa_t5_rl_re.sh ├── run_nli_t5_rl_ra.sh ├── run_nli_t5_rl_re.sh ├── t5_rl.py ├── t5_utils.py └── utils.py └── sim_experiments ├── NLI_data_utils.py ├── QA_data_utils.py ├── README.md ├── T5-2-agent_main.py ├── causal_estimation.Rmd ├── classes.py ├── compute_sim.py ├── data ├── e-SNLI-data │ ├── dev.tsv │ ├── dev.txt │ ├── test.tsv │ ├── test.txt │ ├── train.tsv │ └── train.txt └── v1.0 │ ├── dev.csv │ ├── test.csv │ └── train.csv ├── main.py ├── models └── T5ForMC.py ├── run_tasks.py ├── training_reports └── README.md └── utils.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/README.md -------------------------------------------------------------------------------- /alternative_objectives/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/alternative_objectives/README.md -------------------------------------------------------------------------------- /human_experiments/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/human_experiments/README.md -------------------------------------------------------------------------------- /human_experiments/expert_analysis.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/human_experiments/expert_analysis.Rmd -------------------------------------------------------------------------------- /human_experiments/ratings_analysis.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/human_experiments/ratings_analysis.Rmd -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch==1.4 2 | transformers==2.5.1 3 | numpy 4 | pandas 5 | sacrebleu -------------------------------------------------------------------------------- /rl_experiments/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/README.md -------------------------------------------------------------------------------- /rl_experiments/data/cqa/dev.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/cqa/dev.csv -------------------------------------------------------------------------------- /rl_experiments/data/cqa/test.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/cqa/test.csv -------------------------------------------------------------------------------- /rl_experiments/data/cqa/train.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/cqa/train.csv -------------------------------------------------------------------------------- /rl_experiments/data/e-snli/dev.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/e-snli/dev.tsv -------------------------------------------------------------------------------- /rl_experiments/data/e-snli/test.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/e-snli/test.tsv -------------------------------------------------------------------------------- /rl_experiments/data/e-snli/train.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/e-snli/train.tsv -------------------------------------------------------------------------------- /rl_experiments/data/sm/dataset.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/sm/dataset.jsonl -------------------------------------------------------------------------------- /rl_experiments/data/sm/eval.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/sm/eval.jsonl -------------------------------------------------------------------------------- /rl_experiments/data/sm/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/data/sm/train.jsonl -------------------------------------------------------------------------------- /rl_experiments/models/T5ForMC.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/models/T5ForMC.py -------------------------------------------------------------------------------- /rl_experiments/run_cqa_t5_rl_ra.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/run_cqa_t5_rl_ra.sh -------------------------------------------------------------------------------- /rl_experiments/run_cqa_t5_rl_re.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/run_cqa_t5_rl_re.sh -------------------------------------------------------------------------------- /rl_experiments/run_nli_t5_rl_ra.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/run_nli_t5_rl_ra.sh -------------------------------------------------------------------------------- /rl_experiments/run_nli_t5_rl_re.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/run_nli_t5_rl_re.sh -------------------------------------------------------------------------------- /rl_experiments/t5_rl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/t5_rl.py -------------------------------------------------------------------------------- /rl_experiments/t5_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/t5_utils.py -------------------------------------------------------------------------------- /rl_experiments/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/rl_experiments/utils.py -------------------------------------------------------------------------------- /sim_experiments/NLI_data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/NLI_data_utils.py -------------------------------------------------------------------------------- /sim_experiments/QA_data_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/QA_data_utils.py -------------------------------------------------------------------------------- /sim_experiments/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/README.md -------------------------------------------------------------------------------- /sim_experiments/T5-2-agent_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/T5-2-agent_main.py -------------------------------------------------------------------------------- /sim_experiments/causal_estimation.Rmd: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/causal_estimation.Rmd -------------------------------------------------------------------------------- /sim_experiments/classes.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/classes.py -------------------------------------------------------------------------------- /sim_experiments/compute_sim.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/compute_sim.py -------------------------------------------------------------------------------- /sim_experiments/data/e-SNLI-data/dev.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/e-SNLI-data/dev.tsv -------------------------------------------------------------------------------- /sim_experiments/data/e-SNLI-data/dev.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/e-SNLI-data/dev.txt -------------------------------------------------------------------------------- /sim_experiments/data/e-SNLI-data/test.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/e-SNLI-data/test.tsv -------------------------------------------------------------------------------- /sim_experiments/data/e-SNLI-data/test.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/e-SNLI-data/test.txt -------------------------------------------------------------------------------- /sim_experiments/data/e-SNLI-data/train.tsv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/e-SNLI-data/train.tsv -------------------------------------------------------------------------------- /sim_experiments/data/e-SNLI-data/train.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/e-SNLI-data/train.txt -------------------------------------------------------------------------------- /sim_experiments/data/v1.0/dev.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/v1.0/dev.csv -------------------------------------------------------------------------------- /sim_experiments/data/v1.0/test.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/v1.0/test.csv -------------------------------------------------------------------------------- /sim_experiments/data/v1.0/train.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/data/v1.0/train.csv -------------------------------------------------------------------------------- /sim_experiments/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/main.py -------------------------------------------------------------------------------- /sim_experiments/models/T5ForMC.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/models/T5ForMC.py -------------------------------------------------------------------------------- /sim_experiments/run_tasks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/run_tasks.py -------------------------------------------------------------------------------- /sim_experiments/training_reports/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/training_reports/README.md -------------------------------------------------------------------------------- /sim_experiments/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/peterbhase/LAS-NL-Explanations/HEAD/sim_experiments/utils.py --------------------------------------------------------------------------------