Open AccessCommercial ERP Chatbots : Conversational Intelligence Agents' Performance Analysis, User experience Benchmarks, and Quality Standards
Author(s) -
Uday Kumar Adusumilli,
Rajneesh Pandeya,
Arvind Sebastian,
Nanda Ashwin
Publication year - 2021
Publication title -
international journal of scientific research in science, engineering and technology
Language(s) - English
Resource type - Journals
eISSN - 2395-1990
pISSN - 2394-4099
DOI - 10.32628/ijsrset219415
Subject(s) - chatbot , usability , computer science , dialog system , quality (philosophy) , human–computer interaction , software deployment , presentation (obstetrics) , world wide web , knowledge management , multimedia , software engineering , philosophy , epistemology , dialog box , medicine , radiology
A key goal of this paper is to investigate commercial applications for chatbots and propose several evaluation metrics for evaluating an embodied conversational agent's performance, usability, and overall quality. Our assessment is based on metrics that include a) size of market share & reach, b) range of users and c) likelihood of being the most advanced commercial chatbot created by their creators. Our study examines several aspects of the function of embodied conversational agents, including their visual appearance, implementation of web sites, speech synthesis unit, built-in knowledge base (with general and specialized information), presentation of knowledge and additional functionality, emergency responses in unexpected situations, and user ratings. An evaluation of any commercial chatbot deployment requires a multidimensional assessment and the current state of Conversational Intelligence in the commercial virtual assistant market.