├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── configs └── dataset_paths.json ├── logo.png ├── main.py ├── requirements.txt ├── setup.py └── src ├── __init__.py ├── base_processor.py ├── dataset.py ├── diff_utils.py ├── evaluator.py ├── metrics ├── README.md ├── __init__.py ├── custom_metrics.py ├── easse_preprocessing.py ├── easse_sari.py ├── gleu.py └── update_rouge.py ├── parse_wikitext.py ├── preprocessing.py ├── processors ├── README.md ├── __init__.py ├── fruit.py ├── huggingface_processors.py ├── wafer_insert.py └── wnc.py ├── prompts.py ├── tests └── test_metrics.py └── utils.py /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/README.md -------------------------------------------------------------------------------- /configs/dataset_paths.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/configs/dataset_paths.json -------------------------------------------------------------------------------- /logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/logo.png -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/main.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/requirements.txt -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/setup.py -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/base_processor.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/base_processor.py -------------------------------------------------------------------------------- /src/dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/dataset.py -------------------------------------------------------------------------------- /src/diff_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/diff_utils.py -------------------------------------------------------------------------------- /src/evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/evaluator.py -------------------------------------------------------------------------------- /src/metrics/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/metrics/README.md -------------------------------------------------------------------------------- /src/metrics/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/metrics/custom_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/metrics/custom_metrics.py -------------------------------------------------------------------------------- /src/metrics/easse_preprocessing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/metrics/easse_preprocessing.py -------------------------------------------------------------------------------- /src/metrics/easse_sari.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/metrics/easse_sari.py -------------------------------------------------------------------------------- /src/metrics/gleu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/metrics/gleu.py -------------------------------------------------------------------------------- /src/metrics/update_rouge.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/metrics/update_rouge.py -------------------------------------------------------------------------------- /src/parse_wikitext.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/parse_wikitext.py -------------------------------------------------------------------------------- /src/preprocessing.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/preprocessing.py -------------------------------------------------------------------------------- /src/processors/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/processors/README.md -------------------------------------------------------------------------------- /src/processors/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/processors/fruit.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/processors/fruit.py -------------------------------------------------------------------------------- /src/processors/huggingface_processors.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/processors/huggingface_processors.py -------------------------------------------------------------------------------- /src/processors/wafer_insert.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/processors/wafer_insert.py -------------------------------------------------------------------------------- /src/processors/wnc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/processors/wnc.py -------------------------------------------------------------------------------- /src/prompts.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/prompts.py -------------------------------------------------------------------------------- /src/tests/test_metrics.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/tests/test_metrics.py -------------------------------------------------------------------------------- /src/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/EditEval/HEAD/src/utils.py --------------------------------------------------------------------------------