How the speaker's emotional facial expressions may affect language comprehension

被引:2
|
作者
Hernandez-Gutierrez, David [1 ,2 ]
Munoz, Francisco [1 ,3 ]
Khosrowtaj, Zahra [4 ]
Sommer, Werner [5 ]
Jimenez-Ortega, Laura [1 ,3 ]
Rahman, Rasha Abdel [5 ]
Sanchez-Garcia, Jose [1 ]
Casado, Pilar [1 ,3 ]
Fondevila, Sabela [1 ,3 ]
Espuny, Javier [1 ]
Martin-Loeches, Manuel [1 ,3 ]
机构
[1] Ctr UCM ISCIII Human Evolut & Behav, Madrid, Spain
[2] Basque Ctr Cognit Brain & Language BCBL, Paseo Mikeletegi 69,2, Donostia San Sebastian 20009, Spain
[3] Univ Complutense Madrid, Dept Psychobiol & Methods Behav Sci, Madrid, Spain
[4] Univ Marburg, Dept Psychol, Marburg, Germany
[5] Humboldt Univ, Dept Psychol, Berlin, Germany
关键词
Multimodal language; emotional facial expression; syntax; semantics; P600; PROCESSING EVIDENCE; GENDER AGREEMENT; WORDS; MOOD; INFORMATION; CONTEXT; ERPS;
D O I
10.1080/23273798.2022.2130945
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
During communicative face-to-face interactions, emotional expressions are typically processed along with auditory speech. Although previous research has demonstrated the interaction between emotion and linguistic processes, so far no study has focused on the effect of the speaker's emotional facial expression on natural language processing. In the present event-related potential (ERP) study, participants listened to spoken sentences while seeing the portrait of the speaker's face with either happy, neutral, or fearful emotional expression. In Study 1A, the N400 effect, a neural marker of semantic comprehension, was unaffected by the speaker's emotional expression. In Study 1B, we manipulated morphosyntactic agreement. The P600 effect was boosted by the happy emotional expression. This may be interpreted as reflecting additional effort in linguistic reanalysis, in line with the heuristic processing style that characterises positive emotions. The present results demonstrate an influence of the speaker's emotional facial expressions on non-emotional language processing during audiovisual communicative interactions.
引用
收藏
页码:1478 / 1491
页数:14
相关论文
共 50 条
  • [21] Alexithymia, but not autism spectrum disorder, may be related to the production of emotional facial expressions
    Trevisan, Dominic A.
    Bowering, Marleis
    Birmingham, Elina
    [J]. MOLECULAR AUTISM, 2016, 7 : 1 - 12
  • [22] Alexithymia, but not autism spectrum disorder, may be related to the production of emotional facial expressions
    Dominic A. Trevisan
    Marleis Bowering
    Elina Birmingham
    [J]. Molecular Autism, 7
  • [23] When words feel right: How affective expressions of listeners change a speaker's language use
    Beukeboom, Camiel J.
    [J]. EUROPEAN JOURNAL OF SOCIAL PSYCHOLOGY, 2009, 39 (05) : 747 - 756
  • [24] The road to understanding is paved with the speaker's intentions: Cues to the speaker's attention and intentions affect pronoun comprehension
    Nappa, Rebecca
    Arnold, Jennifer E.
    [J]. COGNITIVE PSYCHOLOGY, 2014, 70 : 58 - 81
  • [25] Emotional and nonemotional facial expressions in people with Parkinson's disease
    Simons, G
    Pasqualini, MCS
    Reddy, V
    Wood, J
    [J]. JOURNAL OF THE INTERNATIONAL NEUROPSYCHOLOGICAL SOCIETY, 2004, 10 (04) : 521 - 535
  • [26] Ostracism modulates children's recognition of emotional facial expressions
    Mermier, Julia
    Quadrelli, Ermanno
    Bulf, Hermann
    Turati, Chiara
    [J]. PLOS ONE, 2023, 18 (06):
  • [27] Visual exploration of emotional facial expressions in Parkinson's disease
    Clark, Uraina S.
    Neargarder, Sandy
    Cronin-Golomb, Alice
    [J]. NEUROPSYCHOLOGIA, 2010, 48 (07) : 1901 - 1913
  • [28] EMOTIONAL CONTEXT'S IMPACT ON PERCEIVING NEUTRAL FACIAL EXPRESSIONS
    Chernykh, Mariia
    Zyma, Igor
    [J]. PSYCHOPHYSIOLOGY, 2018, 55 : S40 - S40
  • [29] How Facial Expressions and Small Talk May Influence Trust in a Robot
    Paradeda, Raul Benites
    Hashemian, Mojgan
    Rodrigues, Rafael Afonso
    Paiva, Ana
    [J]. SOCIAL ROBOTICS, (ICSR 2016), 2016, 9979 : 169 - 178
  • [30] Deficits in decoding emotional facial expressions in Parkinson's disease
    Dujardin, K
    Blairy, S
    Defebvre, L
    Duhem, S
    Noël, Y
    Hess, U
    Destée, A
    [J]. NEUROPSYCHOLOGIA, 2004, 42 (02) : 239 - 250