Open AccessTowards a Semantic Model for Textual Entailment Annotation
Author(s) -
Assaf Toledo,
Stavroula Alexandropoulou,
Sophie Chesney,
Sophia Katrenko,
Heidi Klockmann,
Pepijn Kokke,
Benno Kruit,
Yoad Winter
Publication year - 2014
Publication title -
linguistic issues in language technology
Language(s) - English
Resource type - Journals
eISSN - 1945-3590
pISSN - 1945-3604
DOI - 10.33011/lilt.v9i.1331
Subject(s) - computer science , annotation , textual entailment , natural language processing , lexicon , artificial intelligence , logical consequence , premise , scheme (mathematics) , information retrieval , linguistics , mathematics , mathematical analysis , philosophy
We introduce a new formal semantic model for annotating textual entailments that describes restrictive, intersective, and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1–4 corpora and describe a first-stage annotation scheme on which we based the manual annotation work. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1–4 and were annotated with cross-annotator agreement of 68% on average. The annotated parts of the RTE corpora are publicly available for further research.