Improved Arabic speech recognition system through the automatic generation of fine-grained phonetic transcriptions

被引:12
|
作者
Alsharhan, Eiman [1 ]
Ramsay, Allan [2 ]
机构
[1] Kuwait Univ, Kuwait, Kuwait
[2] Univ Manchester, Manchester, Lancs, England
关键词
D O I
10.1016/j.ipm.2017.07.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper aims at determining the best way to exploit the phonological properties of the Arabic language in order to improve the performance of the speech recognition system. One of the main challenges facing the processing of Arabic is the effect of the local context, which induces changes in the phonetic representation of a given text, thereby causing the recognition engine to misclassify it. The proposed solution is to develop a set of language-dependent grapheme-to-allophone rules that can predict such allophonic variations and hence provide a phonetic transcription that is sensitive to the local context for the automatic speech recognition system. The novel aspect of this method is that the pronunciation of each word is extracted directly from a context-sensitive phonetic transcription rather than a predefined dictionary that typically does not reflect the actual pronunciation of the word. The paper also aims at employing the stress feature as one of the supra-segmental characteristics of speech to enhance the acoustic modelling. The effectiveness of applying the proposed rules has been tested by comparing the performance of a dictionary based system against one using the automatically generated phonetic transcription. The research reported an average of 9.3% improvement in the system's performance by eliminating the fixed dictionary and using the generated phonetic transcription to learn the phone probabilities. Marking the stressed vowels with separate stress markers leads to a further improvement of 1.7%. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:343 / 353
页数:11
相关论文
共 50 条
  • [41] Research on Fine-Grained Image Recognition of Birds Based on Improved YOLOv5
    Yi, Xiaomei
    Qian, Cheng
    Wu, Peng
    Maponde, Brian Tapiwanashe
    Jiang, Tengteng
    Ge, Wenying
    SENSORS, 2023, 23 (19)
  • [42] Press-Plate State Recognition Based on Improved Bilinear Fine-Grained Model
    Yang Qianwen
    Zhou Ke
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (20)
  • [43] IMPROVING END-TO-END CONTEXTUAL SPEECH RECOGNITION WITH FINE-GRAINED CONTEXTUAL KNOWLEDGE SELECTION
    Han, Minglun
    Dong, Linhao
    Liang, Zhenlin
    Cai, Meng
    Zhou, Shiyu
    Ma, Zejun
    Xu, Bo
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8532 - 8536
  • [44] MPAF-CNN: Multiperspective aware and fine-grained fusion strategy for speech emotion recognition
    Li, Guoyan
    Hou, Junjie
    Liu, Yi
    Wei, Jianguo
    APPLIED ACOUSTICS, 2023, 214
  • [45] Demo Abstract: Demonstration of the FABER System for Fine-grained Recognition of Abnormal Behaviors
    Civitarese, Gabriele
    Janjua, Zaffar Haider
    Riboni, Daniele
    Bettini, Claudio
    2015 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATION WORKSHOPS (PERCOM WORKSHOPS), 2015, : 199 - 201
  • [46] Fine-Grained Recognition of Activities of Daily Living through Structural Vibration and Electrical Sensing
    Pan, Shijia
    Berges, Mario
    Rodakowski, Juleen
    Zhang, Pei
    Noh, Hae Young
    BUILDSYS'19: PROCEEDINGS OF THE 6TH ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILDINGS, CITIES, AND TRANSPORTATION, 2019, : 149 - 158
  • [47] Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation
    Huang, Jiaxin
    Meng, Yu
    Han, Jiawei
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 605 - 614
  • [48] Automatic Construction of Fine-Grained Paraphrase Corpora System Using Language Inference Model
    Zhou, Ying
    Hu, Xiaokang
    Chung, Vera
    APPLIED SCIENCES-BASEL, 2022, 12 (01):
  • [49] BoxCars: 3D Boxes as CNN Input for Improved Fine-Grained Vehicle Recognition
    Sochor, Jakub
    Herout, Adam
    Havel, Jiri
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3006 - 3015
  • [50] Fine-Grained Grape Leaf Diseases Recognition Method Based on Improved Lightweight Attention Network
    Wang, Peng
    Niu, Tong
    Mao, Yanru
    Liu, Bin
    Yang, Shuqin
    He, Dongjian
    Gao, Qiang
    FRONTIERS IN PLANT SCIENCE, 2021, 12