├── .gitignore ├── .travis.yml ├── LICENSE ├── MANIFEST.in ├── README.md ├── requirements.txt ├── setup.py ├── src └── fever │ ├── __init__.py │ └── scorer.py ├── tests ├── actual.jsonl ├── dev.jsonl ├── predictions.jsonl ├── test_dev_data.py ├── test_evidence_format.py ├── test_max_evidence.py ├── test_precision.py ├── test_realdata.py ├── test_realdata_100.py ├── test_recall.py ├── test_scorer_dataset.py ├── test_scorer_iscorrect.py └── test_scorer_isstrictlycorrect.py └── version.sh /.gitignore: -------------------------------------------------------------------------------- 1 | build/ 2 | dist/ 3 | *.pyc 4 | -------------------------------------------------------------------------------- /.travis.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/.travis.yml -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/LICENSE -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- 1 | include requirements.txt 2 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/README.md -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | six -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/setup.py -------------------------------------------------------------------------------- /src/fever/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/fever/scorer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/src/fever/scorer.py -------------------------------------------------------------------------------- /tests/actual.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/actual.jsonl -------------------------------------------------------------------------------- /tests/dev.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/dev.jsonl -------------------------------------------------------------------------------- /tests/predictions.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/predictions.jsonl -------------------------------------------------------------------------------- /tests/test_dev_data.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_dev_data.py -------------------------------------------------------------------------------- /tests/test_evidence_format.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_evidence_format.py -------------------------------------------------------------------------------- /tests/test_max_evidence.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_max_evidence.py -------------------------------------------------------------------------------- /tests/test_precision.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_precision.py -------------------------------------------------------------------------------- /tests/test_realdata.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_realdata.py -------------------------------------------------------------------------------- /tests/test_realdata_100.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_realdata_100.py -------------------------------------------------------------------------------- /tests/test_recall.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_recall.py -------------------------------------------------------------------------------- /tests/test_scorer_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_scorer_dataset.py -------------------------------------------------------------------------------- /tests/test_scorer_iscorrect.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_scorer_iscorrect.py -------------------------------------------------------------------------------- /tests/test_scorer_isstrictlycorrect.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/tests/test_scorer_isstrictlycorrect.py -------------------------------------------------------------------------------- /version.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/sheffieldnlp/fever-scorer/HEAD/version.sh --------------------------------------------------------------------------------