Evaluating Automated Theorem Provers Using Adimen-SUMO
Author(s) -
Javier Álvez,
Paqui Lucio,
Germán Rigau
Publication year - 2018
Publication title -
epic series in computing
Language(s) - English
Resource type - Conference proceedings
ISSN - 2398-7340
DOI - 10.29007/hplh
Subject(s) - wordnet , automated theorem proving , set (abstract data type) , computer science , adaptation (eye) , automated reasoning , natural language processing , programming language , order (exchange) , artificial intelligence , theoretical computer science , algorithm , physics , finance , optics , economics
We report on the results of evaluating the performance automated theorem provers using AdimenSUMO. The evaluation follows the adaptation of the methodology based on competency questions [6] to the framework of first-order logic, which is presented in [3], and is applied to Adimen-SUMO [1]. The set of competency questions used for this evaluation has been semi-automatically generated from a small set of semantic patterns and the mapping of WordNet to SUMO, also introduced in [3]. Our experimental results demonstrate that improved versions of the proposed set of competency questions could be really valuable for the development of automated theorem provers.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom