An Evaluation of Chinese Human-Computer Dialogue Technology
Author(s) -
Zhengyu Zhao,
Weinan Zhang,
Wanxiang Che,
Zhigang Chen,
Yibo Zhang
Publication year - 2019
Publication title -
data intelligence
Language(s) - English
Resource type - Journals
eISSN - 2096-7004
pISSN - 2641-435X
DOI - 10.1162/dint_a_00007
Subject(s) - computer science , task (project management) , field (mathematics) , identification (biology) , human–computer interaction , artificial intelligence , scale (ratio) , corporation , data science , engineering , systems engineering , botany , physics , mathematics , finance , quantum mechanics , pure mathematics , economics , biology
The human-computer dialogue has recently attracted extensive attention from both academia and industry as an important branch in the field of artificial intelligence (AI). However, there are few studies on the evaluation of large-scale Chinese human-computer dialogue systems. In this paper, we introduce the Second Evaluation of Chinese Human-Computer Dialogue Technology, which focuses on the identification of a user's intents and intelligent processing of intent words. The Evaluation consists of user intent classification (Task 1) and online testing of task-oriented dialogues (Task 2), the data sets of which are provided by iFLYTEK Corporation. The evaluation tasks and data sets are introduced in detail, and meanwhile, the evaluation results and the existing problems in the evaluation are discussed.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom