Automatic Evaluation of Information Ordering: Kendall's Tau | Zendy

Mirella Lapata | Zendy

AI Assistant Blog Pricing

Home ZAIA Blog

Open Access

Automatic Evaluation of Information Ordering: Kendall's Tau

Author(s) -

Mirella Lapata

Publication year - 2006

Publication title -

computational linguistics

Language(s) - English

Resource type - Journals

SCImago Journal Rank - 0.314

H-Index - 98

eISSN - 1530-9312

pISSN - 0891-2017

DOI - 10.1162/coli.2006.32.4.471

Subject(s) - automatic summarization , computer science , metric (unit) , rank (graph theory) , task (project management) , representation (politics) , correlation , artificial intelligence , reading (process) , natural language processing , rank correlation , information retrieval , machine learning , linguistics , mathematics , operations management , philosophy , geometry , management , combinatorics , politics , political science , law , economics

This article considers the automatic evaluation of information ordering, a task underlying many text-based applications such as concept-to-text generation and multidocument summarization. We propose an evaluation method based on Kendall's τ, a metric of rank correlation. The method is inexpensive, robust, and representation independent. We show that Kendall's τ correlates reliably with human ratings and reading times.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research