Premium
Augmenting Visualization with Natural Language Translation of Interaction: A Usability Study
Author(s) -
Nafari M.,
Weaver C.
Publication year - 2013
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.12126
Subject(s) - computer science , visualization , usability , human–computer interaction , categorical variable , natural language generation , natural language , learnability , focus (optics) , natural language user interface , visual language , natural language processing , artificial intelligence , information retrieval , machine learning , linguistics , philosophy , physics , optics
As visualization tools get more complicated, users often find it increasingly difficult to learn interaction sequences, recall past queries, and interpret visual states. We examine a query‐to‐question (Q2Q) supporting system that takes advantage of natural language generation (NLG) techniques to automatically translate and display query interactions as natural language questions. We focus on a symmetric pattern of multiple coordinated views, cross‐filtered views, that involves only nominal/categorical data. We describe a study of the effects of pairing a visualization with a Q2Q interface on several aspects of usability. Q2Q produces considerable improvements in learnability, efficiency, and memorability of visualization in terms of speed and the length of interaction sequences that users follow, along with a modest decrease in error ratio. From a visual language perspective, we analyze how Q2Q speeds up users’ comprehension of interaction, particularly when a visualization representation has deficiencies in illustrating hidden items or relationships.