├── .gitignore ├── LICENCE ├── README.md ├── probing_task_evaluation.py ├── requirements.txt ├── reval.py └── reval ├── __init__.py ├── dataset_utils.py ├── datasets.py ├── dependency_graph_utils.py ├── engine.py ├── probing_task_example.py └── probing_tasks ├── __init__.py ├── argument_grammatical_role.py ├── argument_order.py ├── argument_type.py ├── entity_distance.py ├── entity_exists_between_head_tail.py ├── entity_type_count_between_head_tail.py ├── pos_tag_argument_position.py ├── probing_task_base.py ├── sdp_tree_depth.py ├── sent_length.py └── tree_depth.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENCE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/LICENCE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/README.md -------------------------------------------------------------------------------- /probing_task_evaluation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/probing_task_evaluation.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/requirements.txt -------------------------------------------------------------------------------- /reval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval.py -------------------------------------------------------------------------------- /reval/__init__.py: -------------------------------------------------------------------------------- 1 | from reval.engine import RE 2 | -------------------------------------------------------------------------------- /reval/dataset_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/dataset_utils.py -------------------------------------------------------------------------------- /reval/datasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/datasets.py -------------------------------------------------------------------------------- /reval/dependency_graph_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/dependency_graph_utils.py -------------------------------------------------------------------------------- /reval/engine.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/engine.py -------------------------------------------------------------------------------- /reval/probing_task_example.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_task_example.py -------------------------------------------------------------------------------- /reval/probing_tasks/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/__init__.py -------------------------------------------------------------------------------- /reval/probing_tasks/argument_grammatical_role.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/argument_grammatical_role.py -------------------------------------------------------------------------------- /reval/probing_tasks/argument_order.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/argument_order.py -------------------------------------------------------------------------------- /reval/probing_tasks/argument_type.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/argument_type.py -------------------------------------------------------------------------------- /reval/probing_tasks/entity_distance.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/entity_distance.py -------------------------------------------------------------------------------- /reval/probing_tasks/entity_exists_between_head_tail.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/entity_exists_between_head_tail.py -------------------------------------------------------------------------------- /reval/probing_tasks/entity_type_count_between_head_tail.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/entity_type_count_between_head_tail.py -------------------------------------------------------------------------------- /reval/probing_tasks/pos_tag_argument_position.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/pos_tag_argument_position.py -------------------------------------------------------------------------------- /reval/probing_tasks/probing_task_base.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/probing_task_base.py -------------------------------------------------------------------------------- /reval/probing_tasks/sdp_tree_depth.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/sdp_tree_depth.py -------------------------------------------------------------------------------- /reval/probing_tasks/sent_length.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/sent_length.py -------------------------------------------------------------------------------- /reval/probing_tasks/tree_depth.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/DFKI-NLP/REval/HEAD/reval/probing_tasks/tree_depth.py --------------------------------------------------------------------------------