Audiovisual emotion perception develops differently from audiovisual phoneme perception during childhood

被引:2
|
作者
Yamamoto, Hisako W. [1 ,2 ]
Kawahara, Misako [1 ,2 ]
Tanaka, Akihiro [1 ]
机构
[1] Tokyo Womans Christian Univ, Suginami Ku, Tokyo, Japan
[2] Japan Soc Promot Sci, Chiyoda Ku, Tokyo, Japan
来源
PLOS ONE | 2020年 / 15卷 / 06期
关键词
VISUAL SPEECH; RECOGNITION; VOICE; FACE;
D O I
10.1371/journal.pone.0234553
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This study investigated the developmental paths in the use of audiovisual information for the perception of emotions and phonemes by Japanese speakers. Children aged 5 to 12 years and adults aged 30 to 39 years engaged in an emotion perception task in which speakers expressed their emotions through their faces and voices, and a phoneme perception task using phonemic information in speakers' lip movements and speech sounds. Results indicated that Japanese children's judgement of emotions by using auditory information increased with increasing age, whereas the use of audiovisual information for judging phonemes remained constant with increasing age. Moreover, adults were affected by visual information more than children. We discuss whether these differences in developmental patterns are due to differential integration processes for information indicative of emotions and phonemes, as well as possible cultural / linguistic reasons for these differences.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Deliberative control in audiovisual sociolinguistic perception*
    Campbell-Kibler, Kathryn
    JOURNAL OF SOCIOLINGUISTICS, 2021, 25 (02) : 253 - 271
  • [22] Lexical influences in audiovisual speech perception
    Brancazio, L
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2004, 30 (03) : 445 - 463
  • [23] Automatic audiovisual integration in speech perception
    Gentilucci, M
    Cattaneo, L
    EXPERIMENTAL BRAIN RESEARCH, 2005, 167 (01) : 66 - 75
  • [24] Audiovisual time perception is spatially specific
    James Heron
    Neil W. Roach
    James V. M. Hanson
    Paul V. McGraw
    David Whitaker
    Experimental Brain Research, 2012, 218 : 477 - 485
  • [25] Anchoring effects in audiovisual speech perception
    Shigeno, S
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2002, 111 (06): : 2853 - 2861
  • [26] Prediction and constraint in audiovisual speech perception
    Peelle, Jonathan E.
    Sommers, Mitchell S.
    CORTEX, 2015, 68 : 169 - 181
  • [27] Language Experience Changes Audiovisual Perception
    Marian, Viorica
    Hayakawa, Sayuri
    Lam, Tuan Q.
    Schroeder, Scott R.
    BRAIN SCIENCES, 2018, 8 (05):
  • [28] Audiovisual perception of gemination and pharyngealization in Arabic
    Scott, Mark
    Idrissi, Ali
    SPEECH COMMUNICATION, 2018, 98 : 17 - 27
  • [29] Audiovisual integration in the human perception of materials
    Fujisaki, Waka
    Goda, Naokazu
    Motoyoshi, Isamu
    Komatsu, Hidehiko
    Nishida, Shin'ya
    JOURNAL OF VISION, 2014, 14 (04):
  • [30] Perception of audiovisual infant directed speech
    Englund, Nunne
    Behne, Dawn M.
    SCANDINAVIAN JOURNAL OF PSYCHOLOGY, 2020, 61 (02) : 218 - 226