MCIC: Multimodal Conversational Intent Classification for E-commerce Customer Service

被引：2

作者：

Yuan, Shaozu ^{[1
]}

Shen, Xin ^{[1
,2
]}

Zhao, Yuming ^{[1
]}

Liu, Hang ^{[1
]}

Yan, Zhiling ^{[1
]}

Liu, Ruixue ^{[1
]}

Chen, Meng ^{[1
]}

机构：

[1] JD AI, Beijing, Peoples R China

[2] Australian Natl Univ, Canberra, ACT, Australia

来源：

NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I | 2022年 / 13551卷

关键词：

Conversational intent classification; Multimodal dataset;

D O I：

10.1007/978-3-031-17120-8_58

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Conversational intent classification (CIC) plays a significant role in dialogue understanding, and most previous works only focus on the text modality. Nevertheless, in real conversations of E-commerce customer service, users often send images (screenshots and photos) among the text, which makes multimodal CIC a challenging task for customer service systems. To understand the intent of a multimodal conversation, it is essential to understand the content of both text and images. In this paper, we construct a large-scale dataset for multimodal CIC in the Chinese E-commerce scenario, named MCIC, which contains more than 30,000 multimodal dialogues with image categories, OCR text (the text contained in images), and intent labels. To fuse visual and textual information effectively, we design two vision-language baselines to integrate either images or OCR text with the dialogue utterances. Experimental results verify that both the text and images are important for CIC in E-commerce customer service.

引用

页码：749 / 761

页数：13

共 50 条

[41] A study on the determinants of e-commerce customer satisfaction
Meng, Lingyi, 1600, Transport and Telecommunication Institute, Lomonosova street 1, Riga, LV-1019, Latvia (18):
[42] Toward emotional e-commerce: The customer agent
Jascanu, Nicolae
Jascanu, Veronica
Bumbaru, Severin
KNOWLEDGE - BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 1, PROCEEDINGS, 2008, 5177 : 202 - 209
[43] A Prediction Approach of E-commerce Customer Loss
Wang, Mingjun
Fang, Jun
2011 INTERNATIONAL CONFERENCE ON COMPUTER, ELECTRICAL, AND SYSTEMS SCIENCES, AND ENGINEERING (CESSE 2011), 2011, : 138 - 141
[44] An e-commerce platform with customer trying-on
Xu, XB
Fang, SL
THIRD INTERNATIONAL CONFERENCE ON ELECTRONIC COMMERCE ENGINEERING: DIGITAL ENTERPRISES AND NONTRADITIONAL INDUSTRIALIZATION, 2003, : 194 - 196
[45] Examining Purchase Intent in Indonesian E-commerce Cosmetics
Sarjono, Haryadi
Soleiman, Mohammad Raihan
Sugi, Gerald
Yohanes, Heppy
Silviya, Ine
PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, VOL 8, ICICT 2024, 2024, 1004 : 85 - 94
[46] Intent-Driven Similarity in E-Commerce Listings
Fuchs, Gilad
Acriche, Yoni
Hasson, Idan
Petrov, Pavel
CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2437 - 2444
[47] Customer-Centric E-commerce Implementing Artificial Intelligence for Better Sales and Service
Thandekkattu, Salu George
Kalaiarasi, M.
PROCEEDINGS OF SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTER ENGINEERING AND COMMUNICATION SYSTEMS, ICACECS 2021, 2022, : 141 - 152
[48] An Emotional Comfort Framework for Improving User Satisfaction in E-Commerce Customer Service Chatbots
Song, Shuangyong
Wang, Chao
Chen, Haiqing
Chen, Huan
2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, NAACL-HLT 2021, 2021, : 130 - 137
[49] An e-commerce logistics service customer relationship management system based on RFM model
Tang F.
International Journal of Applied Systemic Studies, 2023, 10 (02) : 154 - 168
[50] AliMe KBQA: Question Answering over Structured Knowledge for E-Commerce Customer Service
Li, Feng-Lin
Chen, Weijia
Huang, Qi
Guo, Yikun
KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE COMPUTING AND LANGUAGE UNDERSTANDING, 2019, 1134 : 136 - 148

← 1 2 3 4 5 →