Premium
Improving query expansion using WordNet
Author(s) -
Pal Dipasree,
Mitra Mandar,
Datta Kalyankumar
Publication year - 2014
Publication title -
journal of the association for information science and technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.903
H-Index - 145
eISSN - 2330-1643
pISSN - 2330-1635
DOI - 10.1002/asi.23143
Subject(s) - wordnet , computer science , query expansion , information retrieval , term (time) , set (abstract data type) , natural language processing , physics , quantum mechanics , programming language
This study proposes a new way of using WordNet for query expansion ( QE ). We choose candidate expansion terms from a set of pseudo‐relevant documents; however, the usefulness of these terms is measured based on their definitions provided in a hand‐crafted lexical resource such as WordNet . Experiments with a number of standard TREC collections WordNet‐based that this method outperforms existing WordNet ‐based methods. It also compares favorably with established QE methods such as KLD and RM3 . Leveraging earlier work in which a combination of QE methods was found to outperform each individual method (as well as other well‐known QE methods), we next propose a combination‐based QE method that takes into account three different aspects of a candidate expansion term's usefulness: (a) its distribution in the pseudo‐relevant documents and in the target corpus, (b) its statistical association with query terms, and (c) its semantic relation with the query, as determined by the overlap between the WordNet definitions of the term and query terms. This combination of diverse sources of information appears to work well on a number of test collections, viz., TREC 123, TREC 5, TREC 678, TREC robust (new), and TREC 910 collections, and yields significant improvements over competing methods on most of these collections.