How the speaker's emotional facial expressions may affect language comprehension

被引:2
|
作者
Hernandez-Gutierrez, David [1 ,2 ]
Munoz, Francisco [1 ,3 ]
Khosrowtaj, Zahra [4 ]
Sommer, Werner [5 ]
Jimenez-Ortega, Laura [1 ,3 ]
Rahman, Rasha Abdel [5 ]
Sanchez-Garcia, Jose [1 ]
Casado, Pilar [1 ,3 ]
Fondevila, Sabela [1 ,3 ]
Espuny, Javier [1 ]
Martin-Loeches, Manuel [1 ,3 ]
机构
[1] Ctr UCM ISCIII Human Evolut & Behav, Madrid, Spain
[2] Basque Ctr Cognit Brain & Language BCBL, Paseo Mikeletegi 69,2, Donostia San Sebastian 20009, Spain
[3] Univ Complutense Madrid, Dept Psychobiol & Methods Behav Sci, Madrid, Spain
[4] Univ Marburg, Dept Psychol, Marburg, Germany
[5] Humboldt Univ, Dept Psychol, Berlin, Germany
关键词
Multimodal language; emotional facial expression; syntax; semantics; P600; PROCESSING EVIDENCE; GENDER AGREEMENT; WORDS; MOOD; INFORMATION; CONTEXT; ERPS;
D O I
10.1080/23273798.2022.2130945
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
During communicative face-to-face interactions, emotional expressions are typically processed along with auditory speech. Although previous research has demonstrated the interaction between emotion and linguistic processes, so far no study has focused on the effect of the speaker's emotional facial expression on natural language processing. In the present event-related potential (ERP) study, participants listened to spoken sentences while seeing the portrait of the speaker's face with either happy, neutral, or fearful emotional expression. In Study 1A, the N400 effect, a neural marker of semantic comprehension, was unaffected by the speaker's emotional expression. In Study 1B, we manipulated morphosyntactic agreement. The P600 effect was boosted by the happy emotional expression. This may be interpreted as reflecting additional effort in linguistic reanalysis, in line with the heuristic processing style that characterises positive emotions. The present results demonstrate an influence of the speaker's emotional facial expressions on non-emotional language processing during audiovisual communicative interactions.
引用
收藏
页码:1478 / 1491
页数:14
相关论文
共 50 条
  • [1] EMOTIONAL FACIAL PRIMING OF LANGUAGE COMPREHENSION
    Knoeferle, Pia
    Muenster, Katja
    [J]. PSYCHOPHYSIOLOGY, 2015, 52 : S22 - S22
  • [2] Facial reactions to emotional facial expressions: Affect or cognition?
    Hess, U
    Philippot, P
    Blairy, S
    [J]. COGNITION & EMOTION, 1998, 12 (04) : 509 - 531
  • [3] FACTORIZING SPEAKER, LEXICAL AND EMOTIONAL VARIABILITIES OBSERVED IN FACIAL EXPRESSIONS
    Mariooryad, Soroosh
    Busso, Carlos
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2605 - 2608
  • [4] Emotional facial expressions implicitly affect on the regulation of interpersonal distances
    Rapuano, Mariachiara
    Ruggiero, Gennaro
    Iachini, Tina
    [J]. COGNITIVE PROCESSING, 2018, 19 : S68 - S68
  • [5] How Listeners Use Facial Expression to Shift the Emotional Stance of the Speaker's Utterance
    Kaukomaa, Timo
    Perakyla, Anssi
    Ruusuvuori, Johanna
    [J]. RESEARCH ON LANGUAGE AND SOCIAL INTERACTION, 2015, 48 (03) : 319 - 341
  • [6] How Facial Expressions of Emotion Affect Distance Perception
    Kim, Nam-Gyoon
    Son, Heejung
    [J]. FRONTIERS IN PSYCHOLOGY, 2015, 6
  • [7] The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony
    Regel, Stefanie
    Coulson, Seana
    Gunter, Thomas C.
    [J]. BRAIN RESEARCH, 2010, 1311 : 121 - 135
  • [8] How SES May Affect Reading Comprehension and Vocabulary in Language Minority Bilingual and Monolingual Children
    Cangelosi, M.
    Barichello, C.
    Dijkstra, T.
    Palladino, P.
    [J]. READING & WRITING QUARTERLY, 2024, 40 (02) : 170 - 190
  • [9] How the Emotional Content of Discourse Affects Language Comprehension
    Jimenez-Ortega, Laura
    Martin-Loeches, Manuel
    Casado, Pilar
    Sel, Alejandra
    Fondevila, Sabela
    Herreros de Tejada, Pilar
    Schacht, Annekathrin
    Sommer, Werner
    [J]. PLOS ONE, 2012, 7 (03):
  • [10] Situating language in a minimal social context: how seeing a picture of the speaker's face affects language comprehension
    Hernandez-Gutierrez, David
    Munoz, Francisco
    Sanchez-Garcia, Jose
    Sommer, Werner
    Rahman, Rasha Abdel
    Casado, Pilar
    Jimenez-Ortega, Laura
    Espuny, Javier
    Fondevila, Sabela
    Martin-Loeches, Manuel
    [J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2021, 16 (05) : 502 - 511