ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation

被引:0
|
作者
Lovenia, Holy [1 ]
Cahyawijaya, Samuel [1 ]
Winata, Genta Indra [1 ]
Xu, Peng [1 ]
Yan, Xu [1 ]
Liu, Zihan [1 ]
Frieske, Rita [1 ]
Yu, Tiezheng [1 ]
Dai, Wenliang [1 ]
Barezi, Elham J. [1 ]
Chen, Qifeng [1 ]
Ma, Xiaojuan [1 ]
Shi, Bertram E. [1 ]
Fung, Pascale [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Hong Kong, Peoples R China
关键词
code-switching; corpus; bilingual; speech; dialogue; Mandarin Chinese; English; low-resource; SPEECH; READ;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Code-switching is a speech phenomenon occurring when a speaker switches language during a conversation. Despite the spontaneous nature of code-switching in conversational spoken language, most existing works collect code-switching data from read speech instead of spontaneous speech. ASCEND (A Spontaneous Chinese-English Dataset) is a high-quality Mandarin Chinese-English code-switching corpus built on spontaneous multi-turn conversational dialogue sources collected in Hong Kong. We report ASCEND's design and procedure for collecting the speech data, including annotations. ASCEND consists of 10.62 hours of clean speech, collected from 23 bilingual speakers of Chinese and English. Furthermore, we conduct baseline experiments using pre-trained wav2vec 2.0 models, achieving a best performance of 22.69% character error rate and 27.05% mixed error rate.
引用
收藏
页码:7259 / 7268
页数:10
相关论文
共 46 条
  • [41] MECOS: A bilingual Manipuri-English spontaneous code-switching speech corpus for automatic speech recognition
    Singh, Naorem Karline
    Chanu, Yambem Jina
    Pangsatabam, Hoomexsun
    COMPUTER SPEECH AND LANGUAGE, 2024, 87
  • [42] Teachers' Perception of Their Code-Switching Practices in English as a Foreign Language Classes: The Results of Stimulated Recall Interview and Conversation Analysis
    Zainil, Yetti
    Arsyad, Safnil
    SAGE OPEN, 2021, 11 (02):
  • [43] Investigating Multi-task Learning for Automatic Speech Recognition with Code-switching between Mandarin and English
    Song, Xiao
    Zou, Yuexian
    Huang, Shilei
    Chen, Shaobin
    Liu, Yi
    2017 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2017, : 27 - 30
  • [44] The JDDC Corpus: A Large-Scale Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service
    Chen, Meng
    Liu, Ruixue
    Shen, Lei
    Yuan, Shaozu
    Zhou, Jingyan
    Wu, Youzheng
    He, Xiaodong
    Zhou, Bowen
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 459 - 466
  • [45] A bi-annotated Malay-English code-switching (Manglish) dataset of X posts for biological gender identification and authorship attribution
    Maskat, Ruhaila
    Azman, Norazmiera Ayunie
    Nulizairos, Nur Shaheera Shastera
    Zahidin, Nurul Athirah
    Mahadi, Adibah Humairah
    Norshamsul, Siti Rubaya
    Sharif, Mohd Mukhlis Mohd
    Mahdin, Hairulnizam
    DATA IN BRIEF, 2024, 52
  • [46] Code-switching in the conversations of the Chinese trading community in Africa: the case of Botswana How English, Setswana, and Chinese are used to accomplish business goals in Botswana
    Akhidenor, Anthonia Eboseremen
    ENGLISH TODAY, 2013, 29 (04) : 30 - 36