Premium
An Ontological Framework for Supporting the Design and Evaluation of Visual Analytics Systems
Author(s) -
Chen Min,
Ebert David S.
Publication year - 2019
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13677
Subject(s) - workflow , computer science , visual analytics , analytics , premise , data science , visualization , software engineering , management science , knowledge management , data mining , database , linguistics , philosophy , economics
Designing, evaluating, and improving visual analytics (VA) systems is a primary area of activities in our discipline. In this paper, we present an ontological framework for recording and categorizing technical shortcomings to be addressed in a VA workflow, reasoning about the causes of such problems, identifying technical solutions, and anticipating secondary effects of the solutions. The methodology is built on the theoretical premise that designing a VA workflow is an optimization of the cost‐benefit ratio of the processes in the workflow. It makes uses three fundamental measures to group and connect “symptoms”, “causes”, “remedies”, and “side‐effects”, and guide the search for potential solutions to the problems. In terms of requirement analysis and system design, the proposed methodology can enable system designers to explore the decision space in a structured manner. In terms of evaluation, the proposed methodology is time‐efficient and complementary to various forms of empirical studies, such as user surveys, controlled experiments, observational studies, focus group discussions, and so on. In general, it reduces the amount of trial‐and‐error in the lifecycle of VA system development.