A Unified Framework to Improve Learners' Skills of Perception and Production Based on Speech Shadowing and Overlapping

被引:0
|
作者
Minematsu, Nobuaki [1 ]
Nakanishi, Noriko [2 ]
Gao, Yingxiang [1 ]
Sun, Haitong [1 ]
机构
[1] Univ Tokyo, Grad Sch Engn, Tokyo, Japan
[2] Kobe Gakuin Univ, Fac Global Commun, Kobe, Hyogo, Japan
来源
INTERSPEECH 2023 | 2023年
关键词
language learning; perception and production; speech shadowing; utterance comparison; speech game;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
A unified framework to improve learners' skills in perceiving and producing L2 sounds is demonstrated based on speech shadowing and overlapping. Speech shadowing is a training method, where learners are asked to reproduce a given model speech (M) as immediately as possible, and it was proved to be effective in enhancing their L2 speech perception. After several trials of shadowing, the learners are provided with M's script to continue shadowing with no delay, called overlapping. By comparing the shadowing speech (S) and the script-shadowing speech (SS), shadowing breakdowns are measured sequentially, which can characterize listening breakdowns. By comparing M and SS, the prosodic and segmental gaps are analyzed sequentially and presented visually to learners along with imitation scores. All the tasks are implemented as interactive speech games, which help learners to become more proficient in L2 speech perception and production.
引用
收藏
页码:3667 / 3668
页数:2
相关论文
共 50 条
  • [21] Relationship between speech perception and production skills and morphosyntactic development in Spanish-speaking children with Speech Sound Disorders
    Zarzo Benlloch, Miriam
    Ygual Fernandez, Amparo
    Cervera Merida, Jose Francisco
    REVISTA DE INVESTIGACION EN LOGOPEDIA, 2021, 11 (02):
  • [22] Auditory perception and speech production skills of children with cochlear implant assessed by means of questionnaire batteries
    Kubo, Takeshi
    Iwaki, Takako
    Sasaki, Tomo
    ORL-JOURNAL FOR OTO-RHINO-LARYNGOLOGY AND ITS RELATED SPECIALTIES, 2008, 70 (04): : 224 - 228
  • [23] Unified framework for the entropy production and the stochastic interaction based on information geometry
    Ito, Sosuke
    Oizumi, Masafumi
    Amari, Shun-ichi
    PHYSICAL REVIEW RESEARCH, 2020, 2 (03):
  • [24] SPEECH UNDER PHYSICAL STRESS: A PRODUCTION-BASED FRAMEWORK
    Patil, Sanjay
    Sangwan, Abhijeet
    Hansen, John H. L.
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 5146 - 5149
  • [25] Effect of phonemic perception training on the speech production and phonological awareness skills of children with expressive phonological delay
    Rvachew, S
    Nowak, M
    Cloutier, G
    AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY, 2004, 13 (03) : 250 - 263
  • [26] Speech-in-noise perception is linked to rhythm production skills in adult percussionists and non-musicians
    Slater, Jessica
    Kraus, Nina
    Carr, Kali Woodruff
    Tierney, Adam
    Azem, Andrea
    Ashley, Richard
    LANGUAGE COGNITION AND NEUROSCIENCE, 2018, 33 (06) : 710 - 717
  • [27] A Collaborative Game-Based Learning Framework to Improve Computational Thinking Skills
    de Jesus, Angelo Magno
    Silveira, Ismar Frango
    2019 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV), 2019, : 161 - 166
  • [28] On the role of L1 speech production in L2 perception: Evidence from Spanish learners of French
    Kartushina, Natalia
    Frauenfelder, Ulrich Hans
    14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 2117 - 2121
  • [29] A Novel Unified Framework for Speech Enhancement and Bandwidth Extension Based on Jointly Trained Neural Networks
    Liu, Bin
    Tao, Jianhua
    Zheng, Yibin
    2018 11TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2018, : 11 - 15
  • [30] SPEECH-PERCEPTION AND PRODUCTION SKILLS OF STUDENTS WITH IMPAIRED HEARING FROM ORAL AND TOTAL COMMUNICATION EDUCATION SETTINGS
    GEERS, AE
    MOOG, JS
    JOURNAL OF SPEECH AND HEARING RESEARCH, 1992, 35 (06): : 1384 - 1393