Bimodal audio-visual training enhances auditory adaptation process

被引:20
|
作者
Kawase, Tetsuaki [1 ,2 ,3 ]
Sakamoto, Shuichi [4 ]
Hori, Yoko [3 ]
Maki, Atsuko [3 ]
Suzuki, Yoiti [4 ]
Kobayashi, Toshimitsu [3 ]
机构
[1] Tohoku Univ, Lab Rehabilitat Auditory Sci, Grad Sch Biomed Engn, Sendai, Miyagi 9808574, Japan
[2] Tohoku Univ, Dept Audiol, Grad Sch Med, Sendai, Miyagi 9808574, Japan
[3] Tohoku Univ, Dept Otolaryngol Head & Neck Surg, Grad Sch Med, Sendai, Miyagi 9808574, Japan
[4] Tohoku Univ, Elect Commun Res Inst, Sendai, Miyagi 9808574, Japan
关键词
audio-visual; auditory rehabilitation; multimodality; VISUAL SPEECH-PERCEPTION; COCHLEAR IMPLANTATION; PET; JAPANESE; HEARING;
D O I
10.1097/WNR.0b013e32832fbef8
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Effects of auditory training with bimodal audio-visual stimuli on monomodal aural speech intelligibility were examined in individuals with normal hearing using highly degraded noise-vocoded speech sound. Visual cue simultaneously presented with auditory stimuli during the training session significantly improved auditory speech intelligibility not only for words used in the training session, but also untrained words, when compared with the auditory training using only auditory stimuli. Visual information is generally considered to complement insufficient speech information conveyed by the auditory system during audio-visual speech perception. However, the present results showed another beneficial effect of audio-visual training that the visual cue enhances the auditory adaptation process to the degraded new speech sound, which is different from those given during bimodal training. NeuroReport 20:1231-1234 (C) 2009 Wolters Kluwer Health vertical bar Lippincott Williams & Wilkins.
引用
收藏
页码:1231 / 1234
页数:4
相关论文
共 50 条
  • [41] Resource adaptation for Audio-Visual devices in the UPnP QoS architecture
    Ditze, Michael
    Bresser, Torsten
    [J]. 20TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 2, PROCEEDINGS, 2006, : 543 - +
  • [42] Robust Audio-Visual Speech Synchrony Detection by Generalized Bimodal Linear Prediction
    Kumar, Kshitiz
    Navratil, Jiri
    Marcheret, Etienne
    Libal, Vit
    Potamianos, Gerasimos
    [J]. INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 2219 - +
  • [43] Human Audio-Visual Consonant Recognition Analyzed with Three Bimodal Integration Models
    Ma, Zhanyu
    Leijon, Arne
    [J]. INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 820 - 823
  • [44] Adaptation to Social-Linguistic Associations in Audio-Visual Speech
    Babel, Molly
    [J]. BRAIN SCIENCES, 2022, 12 (07)
  • [45] Audio-Visual Speech Synchronization Detection Using a Bimodal Linear Prediction Model
    Kumar, Kshitiz
    Navratil, Jiri
    Marcheret, Etienne
    Libal, Vit
    Ramaswamy, Ganesh
    Potamianos, Gerasimos
    [J]. 2009 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPR WORKSHOPS 2009), VOLS 1 AND 2, 2009, : 670 - +
  • [46] Audio-Visual Spatiotemporal Perceptual Training Enhances the P300 Component in Healthy Older Adults
    Yang, Weiping
    Guo, Ao
    Li, Yueying
    Qiu, Jiajing
    Li, Shengnan
    Yin, Shufei
    Chen, Jianxin
    Ren, Yanna
    [J]. FRONTIERS IN PSYCHOLOGY, 2018, 9
  • [47] AUDIO-VISUAL EDUCATION
    Brickman, William W.
    [J]. SCHOOL AND SOCIETY, 1948, 67 (1739): : 320 - 326
  • [48] Audio-Visual Objects
    Kubovy M.
    Schutz M.
    [J]. Review of Philosophy and Psychology, 2010, 1 (1) : 41 - 61
  • [49] Avatar Therapy: an audio-visual dialogue system for treating auditory hallucinations
    Huckvale, Mark
    Leff, Julian
    Williams, Geoff
    [J]. 14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 392 - 396
  • [50] Audio-Visual Segmentation
    Zhou, Jinxing
    Wang, Jianyuan
    Zhang, Jiayi
    Sun, Weixuan
    Zhang, Jing
    Birchfield, Stan
    Guo, Dan
    Kong, Lingpeng
    Wang, Meng
    Zhong, Yiran
    [J]. COMPUTER VISION, ECCV 2022, PT XXXVII, 2022, 13697 : 386 - 403