z-logo
open-access-imgOpen Access
Toward a unified retrieval outcome analysis framework for cross‐language information retrieval
Author(s) -
Chen Jiangping
Publication year - 2005
Publication title -
proceedings of the american society for information science and technology
Language(s) - English
Resource type - Journals
eISSN - 1550-8390
pISSN - 0044-7870
DOI - 10.1002/meet.14504201106
Subject(s) - computer science , information retrieval , human–computer information retrieval , categorization , cognitive models of information retrieval , query expansion , cross language information retrieval , query language , outcome (game theory) , artificial intelligence , ranking (information retrieval) , mathematics , mathematical economics
This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross‐Language Information Retrieval systems. The ROA framework goes beyond TREC‐type retrieval evaluation methodology by including procedures focusing on individual queries, especially difficult queries. The framework is comprised of four interrelated components: (1) Overall System Performance Evaluation, (2) Query Categorization, (3) Translation Analysis, and (4) Individual Query Analysis. An example of applying the framework is discussed in detail. The author believes the proposed framework would be especially useful for the development of real‐world Cross‐Language Information Retrieval systems because the evaluation guided by the framework has the potential to discover causes behind poor retrieval performance.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.
Having issues? You can contact us here