A Multi-Agent based Multimodal System Adaptive to the User’s Interaction Context

Communication is an important aspect of human life; it is with communication that helps human beings connect with each other as individuals and as independent groups. In informatics, the very purpose of the existence of computer is information dissemination – to be able to send and receive information. Humans are quite successful in conveying ideas with one another and reacting appropriately because we share the richness of our language, have a common understanding of how things work and have an implicit understanding of everyday situations. When human communicate with human, they comprehend the information that is apparent to the current situation, or context, hence increasing the conversational bandwidth. This ability to convey ideas, however, does not transfer when human interacts with computer. On its own, computers do not understand our language, do not understand how the world works and cannot sense information about the current situation. In a typical impoverished computing set-up where providing computer with information is through the use of mouse, keyboard and screen, the result is we explicitly provide information to computers, producing an effect that is contrary to the promise of transparency and calm technology in Marc Weiser’s vision of ubiquitous computing (Weiser 1991; Weiser 1993; Weiser and Brown 1996). To reverse this, it is imperative that methodologies are developed that will enable computers to have access to context. It is through context-awareness that we can increase the richness of communication in humancomputer interaction, through which we can reap the most likely benefit of more useful computational services. Context (Dey and Abowd 1999; Gwizdka 2000; Dey 2001; Coutaz, Crowley et al. 2005) is a subjective idea and its interpretation is personal. Context evolves and the acquisition of contextual information is essential. However, we believe that the one with the final word on whether the envisioned context is correctly captured/acquired or not is the end user. Current research works indicate that some contextual information are already predefined by their systems from the very beginning – this is correct if the application domain is fixed but is incorrect if we infer that a typical user does different computing tasks in different occasions. With the aim of coming up with more conclusive and inclusive design, we conjure that the contextual information that is important to the user should be left to the judgment of the end