├── .gitignore ├── .gitmodules ├── README.md ├── data ├── GUTENBERG_LICENSE ├── LICENSE ├── human-eval │ ├── README.md │ └── all-responses.jsonl ├── v1-1 │ ├── dev.jsonl │ ├── test.jsonl │ └── train.jsonl ├── v1-2 │ ├── html │ │ ├── dev.jsonl │ │ ├── test.jsonl │ │ └── train.jsonl │ └── txt │ │ ├── dev.jsonl │ │ ├── test.jsonl │ │ └── train.jsonl ├── v1-3 │ ├── html │ │ ├── dev.jsonl │ │ ├── test.jsonl │ │ └── train.jsonl │ └── txt │ │ ├── dev.jsonl │ │ ├── test.jsonl │ │ └── train.jsonl └── v1 │ ├── dev.jsonl │ ├── test.jsonl │ └── train.jsonl ├── requirements.txt ├── run_summarization.py ├── scripts └── preprocessing │ └── preprocess_html.py └── utils └── metrics ├── multi_meteor └── multi_meteor.py └── multi_rouge └── multi_rouge.py /.gitignore: -------------------------------------------------------------------------------- 1 | *.swp 2 | *.swo 3 | -------------------------------------------------------------------------------- /.gitmodules: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/.gitmodules -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/README.md -------------------------------------------------------------------------------- /data/GUTENBERG_LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/GUTENBERG_LICENSE -------------------------------------------------------------------------------- /data/LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/LICENSE -------------------------------------------------------------------------------- /data/human-eval/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/human-eval/README.md -------------------------------------------------------------------------------- /data/human-eval/all-responses.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/human-eval/all-responses.jsonl -------------------------------------------------------------------------------- /data/v1-1/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-1/dev.jsonl -------------------------------------------------------------------------------- /data/v1-1/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-1/test.jsonl -------------------------------------------------------------------------------- /data/v1-1/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-1/train.jsonl -------------------------------------------------------------------------------- /data/v1-2/html/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-2/html/dev.jsonl -------------------------------------------------------------------------------- /data/v1-2/html/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-2/html/test.jsonl -------------------------------------------------------------------------------- /data/v1-2/html/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-2/html/train.jsonl -------------------------------------------------------------------------------- /data/v1-2/txt/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-2/txt/dev.jsonl -------------------------------------------------------------------------------- /data/v1-2/txt/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-2/txt/test.jsonl -------------------------------------------------------------------------------- /data/v1-2/txt/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-2/txt/train.jsonl -------------------------------------------------------------------------------- /data/v1-3/html/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-3/html/dev.jsonl -------------------------------------------------------------------------------- /data/v1-3/html/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-3/html/test.jsonl -------------------------------------------------------------------------------- /data/v1-3/html/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-3/html/train.jsonl -------------------------------------------------------------------------------- /data/v1-3/txt/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-3/txt/dev.jsonl -------------------------------------------------------------------------------- /data/v1-3/txt/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-3/txt/test.jsonl -------------------------------------------------------------------------------- /data/v1-3/txt/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1-3/txt/train.jsonl -------------------------------------------------------------------------------- /data/v1/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1/dev.jsonl -------------------------------------------------------------------------------- /data/v1/test.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1/test.jsonl -------------------------------------------------------------------------------- /data/v1/train.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/data/v1/train.jsonl -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /run_summarization.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/run_summarization.py -------------------------------------------------------------------------------- /scripts/preprocessing/preprocess_html.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/scripts/preprocessing/preprocess_html.py -------------------------------------------------------------------------------- /utils/metrics/multi_meteor/multi_meteor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/utils/metrics/multi_meteor/multi_meteor.py -------------------------------------------------------------------------------- /utils/metrics/multi_rouge/multi_rouge.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/nyu-mll/SQuALITY/HEAD/utils/metrics/multi_rouge/multi_rouge.py --------------------------------------------------------------------------------