Summary of the DISPLACE challenge 2023-DIarization of SPeaker and LAnguage in Conversational Environments

被引:0
|
作者
Baghel, Shikha [1 ,2 ]
Ramoji, Shreyas [1 ]
Jain, Somil [2 ]
Chowdhuri, Pratik Roy [2 ]
Singh, Prachi [1 ]
Vijayasenan, Deepu [2 ]
Ganapathy, Sriram [1 ]
机构
[1] Indian Inst Sci, Dept Elect Engn, LEAP Lab, Bengaluru, India
[2] Natl Inst Technol Karnataka, Dept Elect & Commun, Surathkal, India
关键词
DISPLACE challenge; Speaker diarization; Language diarization; Multilingual; Multi-speaker; Code-mix; Code-switch; Conversational audio; RECOGNITION; CORPUS; MODEL;
D O I
10.1016/j.specom.2024.103080
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In multi-lingual societies, where multiple languages are spoken in a small geographic vicinity, informal conversations often involve mix of languages. Existing speech technologies may be inefficient in extracting information from such conversations, where the speech data is rich in diversity with multiple languages and speakers. The DISPLACE (DIarization of SPeaker and LAnguage in Conversational Environments) challenge constitutes an open-call for evaluating and bench-marking the speaker and language diarization technologies on this challenging condition. To facilitate this challenge, a real-world dataset featuring multilingual, multispeaker conversational far-field speech was recorded and distributed. The challenge entailed two tracks: Track-1 focused on speaker diarization (SD) in multilingual situations while, Track-2 addressed the language diarization (LD) in a multi-speaker scenario. Both the tracks were evaluated using the same underlying audio data. Furthermore, a baseline system was made available for both SD and LD task which mimicked the stateof-art in these tasks. The challenge garnered a total of 42 world-wide registrations and received a total of 19 combined submissions for Track-1 and Track-2. This paper describes the challenge, details of the datasets, tasks, and the baseline system. Additionally, the paper provides a concise overview of the submitted systems in both tracks, with an emphasis given to the top performing systems. The paper also presents insights and future perspectives for SD and LD tasks, focusing on the key challenges that the systems need to overcome before wide-spread commercial deployment on such conversations.
引用
收藏
页数:15
相关论文
共 3 条
  • [1] TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challenge
    Pang, Bowen
    Zhao, Huan
    Zhang, Gaosheng
    Yang, Xiaoyue
    Sun, Yang
    Zhang, Li
    Wang, Qing
    Xie, Lei
    [J]. 2022 13TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2022, : 502 - 506
  • [2] The X-Lance Speaker Diarization System for the Conversational Short-phrase Speaker Diarization Challenge 2022
    Liu, Tao
    Xiang, Xu
    Chen, Zhengyang
    Han, Bing
    Yu, Kai
    Qian, Yanmin
    [J]. 2022 13TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2022, : 498 - 501
  • [3] Williams, C. H. (2023). Language policy and the new speaker challenge: hiding in plain sight. Cambridge University Press
    Alejandro Dayán-Fernández
    [J]. Language Policy, 2024, 23 : 105 - 107