Bimodal audio-visual training enhances auditory adaptation process

被引:20
|
作者
Kawase, Tetsuaki [1 ,2 ,3 ]
Sakamoto, Shuichi [4 ]
Hori, Yoko [3 ]
Maki, Atsuko [3 ]
Suzuki, Yoiti [4 ]
Kobayashi, Toshimitsu [3 ]
机构
[1] Tohoku Univ, Lab Rehabilitat Auditory Sci, Grad Sch Biomed Engn, Sendai, Miyagi 9808574, Japan
[2] Tohoku Univ, Dept Audiol, Grad Sch Med, Sendai, Miyagi 9808574, Japan
[3] Tohoku Univ, Dept Otolaryngol Head & Neck Surg, Grad Sch Med, Sendai, Miyagi 9808574, Japan
[4] Tohoku Univ, Elect Commun Res Inst, Sendai, Miyagi 9808574, Japan
关键词
audio-visual; auditory rehabilitation; multimodality; VISUAL SPEECH-PERCEPTION; COCHLEAR IMPLANTATION; PET; JAPANESE; HEARING;
D O I
10.1097/WNR.0b013e32832fbef8
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Effects of auditory training with bimodal audio-visual stimuli on monomodal aural speech intelligibility were examined in individuals with normal hearing using highly degraded noise-vocoded speech sound. Visual cue simultaneously presented with auditory stimuli during the training session significantly improved auditory speech intelligibility not only for words used in the training session, but also untrained words, when compared with the auditory training using only auditory stimuli. Visual information is generally considered to complement insufficient speech information conveyed by the auditory system during audio-visual speech perception. However, the present results showed another beneficial effect of audio-visual training that the visual cue enhances the auditory adaptation process to the degraded new speech sound, which is different from those given during bimodal training. NeuroReport 20:1231-1234 (C) 2009 Wolters Kluwer Health vertical bar Lippincott Williams & Wilkins.
引用
收藏
页码:1231 / 1234
页数:4
相关论文
共 50 条
  • [31] An audio-visual distance for audio-visual speech vector quantization
    Girin, L
    Foucher, E
    Feng, G
    [J]. 1998 IEEE SECOND WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1998, : 523 - 528
  • [32] Catching audio-visual mice:: The extrapolation of audio-visual speed
    Hofbauer, MM
    Wuerger, SM
    Meyer, GF
    Röhrbein, F
    Schill, K
    Zetzsche, C
    [J]. PERCEPTION, 2003, 32 : 96 - 96
  • [33] ROBUST AUDIO-VISUAL SPEECH RECOGNITION USING BIMODAL DFSMN WITH MULTI-CONDITION TRAINING AND DROPOUT REGULARIZATION
    Zhang, Shiliang
    Lei, Ming
    Ma, Bin
    Xie, Lei
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6570 - 6574
  • [34] Neural entrainment to rhythmically presented auditory, visual, and audio-visual speech in children
    Power, Alan James
    Mead, Natasha
    Barnes, Lisa
    Goswami, Usha
    [J]. FRONTIERS IN PSYCHOLOGY, 2012, 3
  • [35] LIBRARY TRAINING BY AUDIO-VISUAL MEANS - A CONCLUSIVE EXPERIMENT
    PENNA, CV
    [J]. UNESCO BULLETIN FOR LIBRARIES, 1970, 24 (05): : 234 - &
  • [36] Audio-visual phoneme classification for pronunciation training applications
    Kjellstrom, Hedvig
    Engwall, Olov
    Abdou, Sherif
    Balter, Olle
    [J]. INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 57 - +
  • [37] The effects of an audio-visual training program in dyslexic children
    Magnan, A
    Ecalle, J
    Veuillet, E
    Collet, L
    [J]. DYSLEXIA, 2004, 10 (02) : 131 - 140
  • [38] FOREIGN LANGUAGE TRAINING BASED ON AUDIO-VISUAL TECHNOLOGIES
    Pisarenko, Veronika
    [J]. 10TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION (ICERI2017), 2017, : 7108 - 7116
  • [39] Audio-Visual Speech Separation with Visual Features Enhanced by Adversarial Training
    Zhang, Peng
    Xu, Jiaming
    Shi, Jing
    Hao, Yunzhe
    Qin, Lei
    Xu, Bo
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [40] An audio-visual speech recognition with a new mandarin audio-visual database
    Liao, Wen-Yuan
    Pao, Tsang-Long
    Chen, Yu-Te
    Chang, Tsun-Wei
    [J]. INT CONF ON CYBERNETICS AND INFORMATION TECHNOLOGIES, SYSTEMS AND APPLICATIONS/INT CONF ON COMPUTING, COMMUNICATIONS AND CONTROL TECHNOLOGIES, VOL 1, 2007, : 19 - +