Open AccessDesign and Implementation of a Multimodal Input Device Using a Web Camera
Author(s) -
Na Jongwhoa,
Choi Wonsuk,
Lee Dongwoo
Publication year - 2008
Publication title -
etri journal
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.295
H-Index - 46
eISSN - 2233-7326
pISSN - 1225-6463
DOI - 10.4218/etrij.08.0208.0018
Subject(s) - computer science , modalities , web application , human–computer interaction , computer hardware , speech recognition , embedded system , operating system , artificial intelligence , sociology , social science
We propose a novel input pointing device called the multimodal mouse (MM) which uses two modalities: face recognition and speech recognition. From an analysis of Microsoft Office workloads, we find that 80% of Microsoft Office Specialist test tasks are compound tasks using both the keyboard and the mouse together. When we use the optical mouse (OM), operation is quick, but it requires a hand exchange delay between the keyboard and the mouse. This takes up a significant amount of the total execution time. The MM operates more slowly than the OM, but it does not consume any hand exchange time. As a result, the MM shows better performance than the OM in many cases.