Bimodal audio-visual training enhances auditory adaptation process

被引:20
|
作者
Kawase, Tetsuaki [1 ,2 ,3 ]
Sakamoto, Shuichi [4 ]
Hori, Yoko [3 ]
Maki, Atsuko [3 ]
Suzuki, Yoiti [4 ]
Kobayashi, Toshimitsu [3 ]
机构
[1] Tohoku Univ, Lab Rehabilitat Auditory Sci, Grad Sch Biomed Engn, Sendai, Miyagi 9808574, Japan
[2] Tohoku Univ, Dept Audiol, Grad Sch Med, Sendai, Miyagi 9808574, Japan
[3] Tohoku Univ, Dept Otolaryngol Head & Neck Surg, Grad Sch Med, Sendai, Miyagi 9808574, Japan
[4] Tohoku Univ, Elect Commun Res Inst, Sendai, Miyagi 9808574, Japan
关键词
audio-visual; auditory rehabilitation; multimodality; VISUAL SPEECH-PERCEPTION; COCHLEAR IMPLANTATION; PET; JAPANESE; HEARING;
D O I
10.1097/WNR.0b013e32832fbef8
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Effects of auditory training with bimodal audio-visual stimuli on monomodal aural speech intelligibility were examined in individuals with normal hearing using highly degraded noise-vocoded speech sound. Visual cue simultaneously presented with auditory stimuli during the training session significantly improved auditory speech intelligibility not only for words used in the training session, but also untrained words, when compared with the auditory training using only auditory stimuli. Visual information is generally considered to complement insufficient speech information conveyed by the auditory system during audio-visual speech perception. However, the present results showed another beneficial effect of audio-visual training that the visual cue enhances the auditory adaptation process to the degraded new speech sound, which is different from those given during bimodal training. NeuroReport 20:1231-1234 (C) 2009 Wolters Kluwer Health vertical bar Lippincott Williams & Wilkins.
引用
收藏
页码:1231 / 1234
页数:4
相关论文
共 50 条
  • [1] Learning Bimodal Structure in Audio-Visual Data
    Monaci, Gianluca
    Vandergheynst, Pierre
    Sommer, Friedrich T.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (12): : 1898 - 1910
  • [2] Audio-visual modeling for bimodal speech recognition
    Kaynak, MN
    Zhi, Q
    Cheok, AD
    Sengupta, K
    Chung, KC
    [J]. 2001 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: E-SYSTEMS AND E-MAN FOR CYBERNETICS IN CYBERSPACE, 2002, : 181 - 186
  • [3] Bimodal fusion in audio-visual speech recognition
    Zhang, XZ
    Mersereau, RM
    Clements, M
    [J]. 2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2002, : 964 - 967
  • [4] Complementarity and synergy in bimodal speech: Auditory, visual, and audio-visual identification of French oral vowels in noise
    Robert-Ribes, J
    Schwartz, JL
    Lallouache, T
    Escudier, P
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1998, 103 (06): : 3677 - 3689
  • [5] Transfer of Audio-Visual Temporal Training to Temporal and Spatial Audio-Visual Tasks
    Suerig, Ralf
    Bottari, Davide
    Roeder, Brigitte
    [J]. MULTISENSORY RESEARCH, 2018, 31 (06) : 556 - 578
  • [6] Head Tracking of Auditory, Visual, and Audio-Visual Targets
    Leung, Johahn
    Wei, Vincent
    Burgess, Martin
    Carlile, Simon
    [J]. FRONTIERS IN NEUROSCIENCE, 2016, 9
  • [7] Audio-Visual Aids and Vocational Training
    Nozet, Henry
    [J]. INTERNATIONAL LABOUR REVIEW, 1952, 66 (04) : 338 - 353
  • [8] The Use of Audio-Visual Aids in Training
    Blackey, Eileen
    [J]. SOCIAL CASEWORK, 1950, 31 (09): : 366 - 371
  • [9] AUDIO-VISUAL TRAINING OF PERCEPTION IN AGEING
    O'Brien, Jessica
    Jason, Chan
    Setti, Annalisa
    [J]. AGE AND AGEING, 2019, 48
  • [10] AUDIO-VISUAL TRAINING IN PAPER INDUSTRY
    JESTER, HM
    [J]. TAPPI, 1966, 49 (03): : A108 - &