An Evaluation of Chinese Human-Computer Dialogue Technology

被引：2

作者：

Zhao, Zhengyu ^{[1
]}

Zhang, Weinan ^{[1
]}

Che, Wanxiang ^{[1
]}

Chen, Zhigang ^{[2
]}

Zhang, Yibo ^{[3
]}

机构：

[1] Harbin Inst Technol, Res Ctr Social Comp & Informat Retrieval, Harbin 150001, Peoples R China

[2] IFLYTEK Co Ltd, AI Res Inst, Hefei 230088, Peoples R China

[3] Huawei Technologies Co Ltd, Shenzhen 518129, Peoples R China

来源：

DATA INTELLIGENCE | 2019年 / 1卷 / 02期

关键词：

Chinese human-computer dialogue evaluation; Evaluation data; User intent classification; Task-oriented dialogue;

D O I：

10.1162/dint_a_00007

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The human-computer dialogue has recently attracted extensive attention from both academia and industry as an important branch in the field of artificial intelligence (AI). However, there are few studies on the evaluation of large-scale Chinese human-computer dialogue systems. In this paper, we introduce the Second Evaluation of Chinese Human-Computer Dialogue Technology, which focuses on the identification of a user's intents and intelligent processing of intent words. The Evaluation consists of user intent classification (Task 1) and online testing of task-oriented dialogues (Task 2), the data sets of which are provided by iFLYTEK Corporation. The evaluation tasks and data sets are introduced in detail, and meanwhile, the evaluation results and the existing problems in the evaluation are discussed.

引用

页码：187 / 200

页数：14

共 50 条

[1] An Evaluation of Chinese Human-Computer Dialogue Technology
Zixian Feng
Caihai Zhu
Weinan Zhang
Zhigang Chen
Wanxiang Che
Minlie Huang
Linlin Li
[J]. Data Intelligence, 2021, 3 (02) : 274 - 286
[2] An Evaluation of Chinese Human-Computer Dialogue Technology
Feng, Zixian
Zhu, Caihai
Zhang, Weinan
Chen, Zhigang
Che, Wanxiang
Huang, Minlie
Li, Linlin
[J]. DATA INTELLIGENCE, 2021, 3 (02) : 274 - 286
[3] An Evaluation of Chinese Human-Computer Dialogue Technology
Zhengyu Zhao
Weinan Zhang
Wanxiang Che
Zhigang Chen
Yibo Zhang
[J]. Data Intelligence, 2019, 1 (02) : 187 - 200
[4] A GRAMMATICAL SPECIFICATION OF HUMAN-COMPUTER DIALOGUE
NYMEYER, A
[J]. COMPUTER LANGUAGES, 1995, 21 (01): : 1 - 16
[5] Recent Advances on Human-Computer Dialogue
Wang, Xiaojie
Yuan, Caixia
[J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2016, 1 (04) : 303 - +
[6] The human-computer dialogue in learning environments
Tarby, JC
[J]. COMPUTER APPLICATIONS IN ENGINEERING EDUCATION, 1997, 5 (01) : 29 - 39
[7] Human-computer dialogue breakdown detection
de Andrade, Leonardo
Paraboni, Ivandre
[J]. LINGUAMATICA, 2022, 14 (01): : 17 - 31
[8] Informal logic dialogue games in human-computer dialogue
Yuan, Tangming
Moore, David
Reed, Chris
Ravenscroft, Andrew
Maudet, Nicolas
[J]. KNOWLEDGE ENGINEERING REVIEW, 2011, 26 (02): : 159 - 174
[9] SPOKEN MULTIMODAL HUMAN-COMPUTER DIALOGUE Introduction
[J]. SPOKEN MULTIMODAL HUMAN-COMPUTER DIALOGUE IN MOBILE ENVIRONMENTS, 2005, 28 : XXI - XXVIII
[10] The Human-Computer Dialogue Management of FCAD System
张福炎
蔡士杰
王曙
葛如顶
[J]. Journal of Computer Science & Technology, 1988, (03) : 221 - 227

← 1 2 3 4 5 →