Characterizing user behavior for speech and sketch-based video retrieval interfaces | Zendy

Ozan Can Altıok | Zendy; Tevfik Metin Sezgin | Zendy

AI Assistant Blog Pricing

Home ZAIA Blog

Open Access

Characterizing user behavior for speech and sketch-based video retrieval interfaces

Author(s) -

Ozan Can Altıok,

Tevfik Metin Sezgin

Publication year - 2017

Publication title -

digital collections portal (koç university)

Language(s) - English

Resource type - Conference proceedings

ISBN - 978-1-4503-5080-8

DOI - 10.1145/3092919.3122801

Subject(s) - computer science , sketch , perspective (graphical) , human–computer interaction , protocol (science) , set (abstract data type) , task (project management) , motion (physics) , information retrieval , multimedia , artificial intelligence , programming language , medicine , pathology , algorithm , economics , alternative medicine , management

From a user interaction perspective, speech and sketching make a good couple for describing motion. Speech allows easy specification of content, events and relationships, while sketching brings in spatial expressiveness. Yet, we have insufficient knowledge of how sketching and speech can be used for motion-based video retrieval, because there are no existing retrieval systems that support such interaction. In this paper, we describe a Wizard-of-Oz protocol and a set of tools that we have developed to engage users in a sketch- and speech-based video retrieval task. We report how the tools and the protocol fit together using \"retrieval of soccer videos\" as a use case scenario. Our software is highly customizable, and our protocol is easy to follow. We believe that together they will serve as a convenient and powerful duo for studying a wide range of multi-modal use cases.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research