An Evaluation of Chinese Human-Computer Dialogue Technology

被引：1

作者：

Feng, Zixian ^{[1
]}

Zhu, Caihai ^{[1
]}

Zhang, Weinan ^{[1
]}

Chen, Zhigang ^{[2
]}

Che, Wanxiang ^{[1
]}

Huang, Minlie ^{[3
]}

Li, Linlin ^{[4
]}

机构：

[1] Harbin Inst Technol, Res Ctr Social Comp & Informat Retrieval, Harbin 150001, Peoples R China

[2] IFLYTEK CO LTD, AI Res Inst, Hefei 230088, Peoples R China

[3] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China

[4] HUAWEI Technol CO LTD, Consumer BG, Nanjing 210012, Peoples R China

来源：

DATA INTELLIGENCE | 2021年 / 3卷 / 02期

基金：

中国国家自然科学基金;

关键词：

Chinese human-computer dialogue evaluation; Evaluation data; Few-shot learning; Knowledge-driven multi-turn dialogue;

D O I：

10.1162/dint_a_00090

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

There is a growing interest in developing human-computer dialogue systems which is an important branch in the field of artificial intelligence (AI). However, the evaluation of large-scale Chinese human-computer dialogues is still a challenging task. To attract more attention to dialogue evaluation work, we held the fourth Evaluation of Chinese Human-Computer Dialogue Technology (ECDT). It consists of few-shot learning in spoken language understanding (SLU) (Task 1) and knowledge-driven multi-turn dialogue competition (Task 2), the data sets of which are provided by Harbin Institute of Technology and Tsinghua University. In this paper, we will introduce the evaluation tasks and data sets in detail. Meanwhile, we will also analyze the evaluation results and the existing problems in the evaluation.

引用

页码：274 / 286

页数：13

共 50 条

[21] Effective human-computer cooperative spoken dialogue: The AGS demonstrator
Sadek, MD
Ferrieux, A
Cozannet, A
Bretier, P
Panaget, F
Simonin, J
ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, 1996, : 546 - 549
[22] Human-computer dialogue simulation using hidden Markov models
Cuayáhuitl, H
Renals, S
Lemon, O
Shimodaira, H
2005 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING (ASRU), 2005, : 290 - 295
[23] A Dialogue-Based Interaction System for Human-Computer Interfaces
Bel-Enguix, G.
Dediu, A. H.
Jimenez-Lopez, M. D.
HUMAN-COMPUTER SYSTEMS INTERACTION: BACKGROUNDS AND APPLICATIONS, 2009, 60 : 55 - 65
[24] Artificial Intelligent Human-Computer Dialogue Support Platform for Hospitals
Xia, Xin
Ma, Yunlong
Luo, Ye
Lu, Jianwei
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (06)
[25] A human-computer debating system prototype and its dialogue strategies
Yuan, Tangming
Moore, David
Grierson, Alec
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2007, 22 (01) : 133 - 156
[26] EFFECTS OF SELF-DISCLOSURE AND EMPATHY IN HUMAN-COMPUTER DIALOGUE
Higashinaka, Ryuichiro
Dohsaka, Kohji
Isozaki, Hideki
2008 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY: SLT 2008, PROCEEDINGS, 2008, : 109 - 112
[27] HUMAN-COMPUTER INTERFACES - MODELING AND EVALUATION
LEE, CH
PAZ, NM
COMPUTERS & INDUSTRIAL ENGINEERING, 1991, 21 (1-4) : 577 - 581
[28] Human-computer interaction in the new process technology
Nishitani, H
JOURNAL OF PROCESS CONTROL, 1996, 6 (2-3) : 111 - 117
[29] Computer Vision for Human-Computer Interaction Using Noninvasive Technology
Ramadoss, Janarthanan
Venkatesh, J.
Joshi, Shubham
Shukla, Piyush Kumar
Jamal, Sajjad Shaukat
Altuwairiqi, Majid
Tiwari, Basant
SCIENTIFIC PROGRAMMING, 2021, 2021
[30] Situated Meaning in Multimodal Dialogue: Human-Robot and Human-Computer Interactions
Pustejovsky, James
Krishnaswamy, Nikhil
TRAITEMENT AUTOMATIQUE DES LANGUES, 2020, 61 (03): : 17 - 41

← 1 2 3 4 5 →