├── ACL2015-dataset.csv └── README.md /README.md: -------------------------------------------------------------------------------- 1 | # ACL 2015 paper dataset 2 | 3 | This repository contains the dataset for the ACL 2015 paper "Learning to Explain Entity Relationships in Knowledge Graphs" by Nikos Voskarides, Edgar Meij, Manos Tsagkias, Maarten de Rijke and Wouter Weerkamp. This paper presents a method for automatically explaining relationships between entities. 4 | 5 | The file `ACL2015-dataset.csv` contains the annotated sentences and it has the following format : 6 | 7 | - `QueryID` the query id 8 | 9 | - `Entity1URL` the url of entity1 10 | 11 | - `Entity2URL` the url of entity2 12 | 13 | - `Relationship` The automatically produced relationship between the two entities, with the form [Entity1Type, Relationship, Entity2Type]. 14 | 15 | - `Relevance` The relevance judgement for the sentence with respect to the two entities and the relationship. We use a five-level graded relevance scale (perfect, excellent, good, fair, bad). The annotators also marked sentences that did not fit in that scale because of different issues (wrong entities, same entities/different relationship, wrong relationship, other). In our experiments we treated all the sentences with such issues as bad sentences. 16 | 17 | - `Description` The automatically extracted wikipedia candidate sentence. 18 | 19 | For more details about the dataset, please refer to the paper. 20 | 21 | If you have any questions, please contact n.voskarides AT uva.nl 22 | --------------------------------------------------------------------------------