An Evaluation of Chinese Human-Computer Dialogue Technology

被引：1

作者：

Feng, Zixian ^{[1
]}

Zhu, Caihai ^{[1
]}

Zhang, Weinan ^{[1
]}

Chen, Zhigang ^{[2
]}

Che, Wanxiang ^{[1
]}

Huang, Minlie ^{[3
]}

Li, Linlin ^{[4
]}

机构：

[1] Harbin Inst Technol, Res Ctr Social Comp & Informat Retrieval, Harbin 150001, Peoples R China

[2] IFLYTEK CO LTD, AI Res Inst, Hefei 230088, Peoples R China

[3] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China

[4] HUAWEI Technol CO LTD, Consumer BG, Nanjing 210012, Peoples R China

来源：

DATA INTELLIGENCE | 2021年 / 3卷 / 02期

基金：

中国国家自然科学基金;

关键词：

Chinese human-computer dialogue evaluation; Evaluation data; Few-shot learning; Knowledge-driven multi-turn dialogue;

D O I：

10.1162/dint_a_00090

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

There is a growing interest in developing human-computer dialogue systems which is an important branch in the field of artificial intelligence (AI). However, the evaluation of large-scale Chinese human-computer dialogues is still a challenging task. To attract more attention to dialogue evaluation work, we held the fourth Evaluation of Chinese Human-Computer Dialogue Technology (ECDT). It consists of few-shot learning in spoken language understanding (SLU) (Task 1) and knowledge-driven multi-turn dialogue competition (Task 2), the data sets of which are provided by Harbin Institute of Technology and Tsinghua University. In this paper, we will introduce the evaluation tasks and data sets in detail. Meanwhile, we will also analyze the evaluation results and the existing problems in the evaluation.

引用

下载

页码：274 / 286

页数：13

共 50 条

[1] An Evaluation of Chinese Human-Computer Dialogue Technology
Zixian Feng
Caihai Zhu
Weinan Zhang
Zhigang Chen
Wanxiang Che
Minlie Huang
Linlin Li
Data Intelligence, 2021, 3 (02) : 274 - 286
[2] An Evaluation of Chinese Human-Computer Dialogue Technology
Zhao, Zhengyu
Zhang, Weinan
Che, Wanxiang
Chen, Zhigang
Zhang, Yibo
DATA INTELLIGENCE, 2019, 1 (02) : 187 - 200
[3] An Evaluation of Chinese Human-Computer Dialogue Technology
Zhengyu Zhao
Weinan Zhang
Wanxiang Che
Zhigang Chen
Yibo Zhang
Data Intelligence, 2019, 1 (02) : 187 - 200
[4] A GRAMMATICAL SPECIFICATION OF HUMAN-COMPUTER DIALOGUE
NYMEYER, A
COMPUTER LANGUAGES, 1995, 21 (01): : 1 - 16
[5] Recent Advances on Human-Computer Dialogue
Wang, Xiaojie
Yuan, Caixia
CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2016, 1 (04) : 303 - +
[6] Human-computer dialogue breakdown detection
de Andrade, Leonardo
Paraboni, Ivandre
LINGUAMATICA, 2022, 14 (01): : 17 - 31
[7] The human-computer dialogue in learning environments
Tarby, JC
COMPUTER APPLICATIONS IN ENGINEERING EDUCATION, 1997, 5 (01) : 29 - 39
[8] Informal logic dialogue games in human-computer dialogue
Yuan, Tangming
Moore, David
Reed, Chris
Ravenscroft, Andrew
Maudet, Nicolas
KNOWLEDGE ENGINEERING REVIEW, 2011, 26 (02): : 159 - 174
[9] SPOKEN MULTIMODAL HUMAN-COMPUTER DIALOGUE Introduction
SPOKEN MULTIMODAL HUMAN-COMPUTER DIALOGUE IN MOBILE ENVIRONMENTS, 2005, 28 : XXI - XXVIII
[10] The Human-Computer Dialogue Management of FCAD System
张福炎
蔡士杰
王曙
葛如顶
Journal of Computer Science & Technology, 1988, (03) : 221 - 227

← 1 2 3 4 5 →