A cross-lingual adaptation approach for rapid development of speech recognizers for learning disabled users

被引:0
|
作者
Marek Bohac
Michaela Kucharova
Zoraida Callejas
Jan Nouza
Petr Červa
机构
[1] Technical University of Liberec,Institute of Information Technology and Electronics
[2] University of Granada,Department of Languages and Computer Systems
[3] CITIC-UGR,undefined
关键词
Automatic speech recognition; Cross-lingual adaptation; Assistive technology; Speech technology; Atypical voices; Learning disabled; Intellectual disability; Dysarthria;
D O I
暂无
中图分类号
学科分类号
摘要
Building a voice-operated system for learning disabled users is a difficult task that requires a considerable amount of time and effort. Due to the wide spectrum of disabilities and their different related phonopathies, most approaches available are targeted to a specific pathology. This may improve their accuracy for some users, but makes them unsuitable for others. In this paper, we present a cross-lingual approach to adapt a general-purpose modular speech recognizer for learning disabled people. The main advantage of this approach is that it allows rapid and cost-effective development by taking the already built speech recognition engine and its modules, and utilizing existing resources for standard speech in different languages for the recognition of the users’ atypical voices. Although the recognizers built with the proposed technique obtain lower accuracy rates than those trained for specific pathologies, they can be used by a wide population and developed more rapidly, which makes it possible to design various types of speech-based applications accessible to learning disabled users.
引用
收藏
相关论文
共 50 条
  • [21] Cross-Lingual Speech-to-Text Summarization
    Pontes, Elvys Linhares
    Gonzalez-Gallardo, Carlos-Emiliano
    Torres-Moreno, Juan-Manuel
    Huet, Stephane
    MULTIMEDIA AND NETWORK INFORMATION SYSTEMS, 2019, 833 : 385 - 395
  • [22] Speech Emotion Recognition with Cross-lingual Databases
    Chiou, Bo-Chang
    Chen, Chia-Ping
    15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4, 2014, : 558 - 561
  • [23] Cross-lingual textual entailment using deep learning approach
    Belay, Wubie
    Meshesha, Million
    Melesew, Dagnachew
    2021 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY FOR DEVELOPMENT FOR AFRICA (ICT4DA), 2021, : 48 - 53
  • [24] A Machine Learning Approach to Multilingual and Cross-Lingual Ontology Matching
    Spohr, Dennis
    Hollink, Laura
    Cimiano, Philipp
    SEMANTIC WEB - ISWC 2011, PT I, 2011, 7031 : 665 - +
  • [25] Cross-lingual Adaptation Using Universal Dependencies
    Taghizadeh, Nasrin
    Faili, Heshaam
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (04)
  • [26] Cross-lingual transfer learning: A PARAFAC2 approach
    Pantraki, Evangelia
    Tsingalis, Ioannis
    Kotropoulos, Constantine
    PATTERN RECOGNITION LETTERS, 2022, 159 : 167 - 173
  • [27] SimCSum: Joint Learning of Simplification and Cross-lingual Summarization for Cross-lingual Science Journalism
    Fatima, Mehwish
    Kolber, Tim
    Markert, Katja
    Strube, Michael
    NewSumm 2023 - Proceedings of the 4th New Frontiers in Summarization Workshop, Proceedings of EMNLP Workshop, 2023, : 24 - 40
  • [28] A joint learning approach with knowledge injection for zero-shot cross-lingual hate speech detection
    Pamungkas, Endang Wahyu
    Basile, Valerio
    Patti, Viviana
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (04)
  • [29] Cross-lingual Adaptation for Recipe Retrieval with Mixup
    Zhu, Bin
    Ngo, Chong-Wah
    Chen, Jingjing
    Chan, Wing-Kwong
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 258 - 267
  • [30] MAXIMUM A POSTERIORI ADAPTATION OF SUBSPACE GAUSSIAN MIXTURE MODELS FOR CROSS-LINGUAL SPEECH RECOGNITION
    Lu, Liang
    Ghoshal, Arnab
    Renals, Steve
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 4877 - 4880