A Computer-Assisted Interpreting System for Multilingual Conferences Based on Automatic Speech Recognition

被引:0
|
作者
Liu, Jichao [1 ]
Liu, Chengpan [2 ]
Shan, Buzheng [3 ]
Ganiyusufoglu, Omer S. [4 ]
机构
[1] Tongji Univ, Sch Foreign Studies, Shanghai 200092, Peoples R China
[2] Civil Aviation Univ China, Sino European Inst Aviation Engn, Tianjin 300300, Peoples R China
[3] Texas A&M Univ, Dept Math, College Stn, TX 77843 USA
[4] Qingdao Int Academician Pk, Qingdao 266199, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Hidden Markov models; Artificial intelligence; Machine translation; Automatic speech recognition; Artificial neural networks; Text recognition; Task analysis; Computer aided analysis; Computer-aided interpreting; CAI; simultaneous interpreting; automatic speech recognition; artificial intelligence;
D O I
10.1109/ACCESS.2024.3400014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Computer-aided interpreting(CAI) systems are software applied to one or more stages of interpreting tasks, which can directly promote the work of interpreters and improve the interpreting quality. Until now, studies on CAI in simultaneous interpretation(SI) have been limited, primarily focusing on the design and development of manual extraction models. Moreover, what's particularly noteworthy is the lack of thorough investigation into the development of fully automated CAI models for extracting terms (SI difficulties) and other related aspects. Based on the experimental research of existing ones, this study puts forward some new methods based on automatic speech recognition(ASR) and develops a CAI system-InterpretSIMPLE with user-friendly interface, which implements automatic retrieval and display of terms (pre-imported), numbers, etc. as well as other functions specialized for conference interpreters. Through the setting of three-line label control and underline panel control, the system realizes the attention allocation and positioning of the source text content at different levels. One-click import of commonly-used Excel glossary gives simple operation with no additional format conversion. Terminologies and numbers are displayed below the corresponding position while displaying the source text, so that interpreters could locate and solve these recognized SI difficulties. Through the "exact matching" or "partial matching" setting, it could meet the personalized requirements of terms matching. The experiment shows that after the system receives text information from Tencent Cloud, the real-time display rate of the pre-imported glossary reaches 98.92%. The research results could provide references for the research and development of in-process automated CAI tools.
引用
下载
收藏
页码:67498 / 67511
页数:14
相关论文
共 50 条
  • [31] Automatic Speech Recognition for Uyghur through Multilingual Acoustic Modeling
    Abulimiti, Ayimunishagu
    Schultz, Tanja
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 6444 - 6449
  • [32] IMPROVING COMPUTER ASSISTED SPEECH THERAPY THROUGH SPEECH BASED EMOTION RECOGNITION
    Schipor, Ovidiu Andrei
    LET'S BUILD THE FUTURE THROUGH LEARNING INNOVATION!, VOL. 1, 2014, : 101 - 104
  • [33] A system for computer-assisted design of inorganic compounds based on computer training
    Kiselyova N.N.
    Stolyarenko A.V.
    Ryazanov V.V.
    Sen'ko O.V.
    Dokukin A.A.
    Podbel'skii V.V.
    Pattern Recognition and Image Analysis, 2011, 21 (01) : 88 - 94
  • [34] An Examination of Automatic Speech Recognition (ASR)-based Computer-assisted Pronunciation Training (CAPT) for Less-proficient EFL Students Using the Technology Acceptance Model
    Hsu, Hsiao-Wen
    INTERNATIONAL JOURNAL OF TECHNOLOGY IN EDUCATION, 2024, 7 (03): : 456 - 473
  • [35] COMPUTER-ASSISTED VOICE RECOGNITION FOR RADIOLOGICAL REPORTING
    MROSEK, B
    GRUNUPP, A
    KEPPEL, E
    KUNZMANN, S
    MOESE, G
    MOHR, K
    STARGARDT, A
    GUNTHER, RW
    FORTSCHRITTE AUF DEM GEBIETE DER RONTGENSTRAHLEN UND DER NEUEN BILDGEBENDEN VERFAHREN, 1993, 159 (05): : 481 - 483
  • [36] Computer-assisted pattern recognition of autoantibody results
    Binder, SR
    Genovese, MC
    Merrill, JT
    Morris, RI
    Metzger, AL
    CLINICAL AND DIAGNOSTIC LABORATORY IMMUNOLOGY, 2005, 12 (12) : 1353 - 1357
  • [37] Online Intention Recognition for Computer-Assisted Teleoperation
    Stefanov, Nikolay
    Peer, Angelika
    Buss, Martin
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 5334 - 5339
  • [38] COMPUTER-ASSISTED RECOGNITION OF GLAUCOMATOUS FIELD LOSS
    HEIJL, A
    LINDGREN, G
    OLSSON, J
    ARCHIVES OF OPHTHALMOLOGY, 1988, 106 (06) : 721 - 722
  • [39] AUTOMATIC SPEECH RECOGNITION SYSTEM
    RUSKE, G
    UMSCHAU IN WISSENSCHAFT UND TECHNIK, 1979, 79 (18) : 566 - 572
  • [40] Automatic Speech Recognition System Based on Wavelet Analysis
    Ziolko, Mariusz
    Galka, Jakub
    Ziolko, Bartosz
    Jadczyk, Tomasz
    Skurzok, Dawid
    Wicijowski, Jan
    2010 IEEE FOURTH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2010), 2010, : 450 - 451