Open AccessUncovering Patterns in Reviewers’ Feedback to Scene Description Authors
Author(s) -
Rosiatalie,
Jolene Loh,
Huei Suen Tan,
Joshua Tseng,
Hernisa Kacorri,
Kotaro Hara
Publication year - 2021
Publication title -
singapore management university institutional knowledge (ink) (singapore management university)
Language(s) - English
Resource type - Conference proceedings
DOI - 10.1145/3441852.3476550
Subject(s) - computer science , utterance , quality (philosophy) , action (physics) , process (computing) , human–computer interaction , audio feedback , multimedia , automation , artificial intelligence , philosophy , physics , epistemology , quantum mechanics , acoustics , operating system , mechanical engineering , engineering
Audio descriptions (ADs) can increase access to videos for blind people. Researchers have explored different mechanisms for generating ADs, with some of the most recent studies involving paid novices; to improve the quality of their ADs, novices receive feedback from reviewers. However, reviewer feedback is not instantaneous. To explore the potential for real-time feedback through automation, in this paper, we analyze 1, 120 comments that 40 sighted novices received from a sighted or a blind reviewer. We find that feedback patterns tend to fall under four themes: (i) Quality ; commenting on different AD quality variables, (ii) Speech Act ; the utterance or speech action that the reviewers used, (iii) Required Action ; the recommended action that the authors should do to improve the AD, and (iv) Guidance ; the additional help that the reviewers gave to help the authors. We discuss which of these patterns could be automated within the review process as design implications for future AD collaborative authoring systems.