Challenges of evaluating the information visualisation experience

Information Visualisation (InfoVis) is defined as an interactive visual representation of abstract data. We view the user’s interaction with InfoVis tools as an experience which is made up of a set of highly demanding cognitive activities. These activities assist users in making sense and gaining knowledge of the represented domain. Usability studies that involve a task-based analysis and usability questionnaires are not enough to capture such an experience. This paper discusses the challenges involved when it comes to evaluating InfoVis tools by giving an overview of the activities involved in an InfoVis experience and demonstrating how they affect the visualisation process. The argument in this paper is based on our experiences in designing, building and evaluating an academic literature visualisation tool.