├── CONTRIBUTING ├── LICENSE ├── README.md ├── baseline └── simple_baseline.py ├── datasets ├── test_prefix.npy ├── train_dataset.csv ├── val_dataset.csv ├── val_prefix.npy ├── val_preprefix.npy └── val_suffix.npy ├── detailed_description.pdf ├── example_submission ├── example_submission.csv ├── fake_test_suffixes.npy ├── generate_fake_data.py ├── score_submission.py └── validate_submission.py ├── load_dataset.py └── requirements.txt /CONTRIBUTING: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/CONTRIBUTING -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/README.md -------------------------------------------------------------------------------- /baseline/simple_baseline.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/baseline/simple_baseline.py -------------------------------------------------------------------------------- /datasets/test_prefix.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/datasets/test_prefix.npy -------------------------------------------------------------------------------- /datasets/train_dataset.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/datasets/train_dataset.csv -------------------------------------------------------------------------------- /datasets/val_dataset.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/datasets/val_dataset.csv -------------------------------------------------------------------------------- /datasets/val_prefix.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/datasets/val_prefix.npy -------------------------------------------------------------------------------- /datasets/val_preprefix.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/datasets/val_preprefix.npy -------------------------------------------------------------------------------- /datasets/val_suffix.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/datasets/val_suffix.npy -------------------------------------------------------------------------------- /detailed_description.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/detailed_description.pdf -------------------------------------------------------------------------------- /example_submission/example_submission.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/example_submission/example_submission.csv -------------------------------------------------------------------------------- /example_submission/fake_test_suffixes.npy: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/example_submission/fake_test_suffixes.npy -------------------------------------------------------------------------------- /example_submission/generate_fake_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/example_submission/generate_fake_data.py -------------------------------------------------------------------------------- /example_submission/score_submission.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/example_submission/score_submission.py -------------------------------------------------------------------------------- /example_submission/validate_submission.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/example_submission/validate_submission.py -------------------------------------------------------------------------------- /load_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/load_dataset.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/google-research/lm-extraction-benchmark/HEAD/requirements.txt --------------------------------------------------------------------------------