NEMO: A Database for Emotion Analysis Using Functional Near-Infrared Spectroscopy

被引:0
|
作者
Spape, Michiel [1 ,2 ]
Makela, Kalle [1 ]
Ruotsalo, Tuukka [3 ,4 ]
机构
[1] Univ Helsinki, Helsinki 00100, Finland
[2] Univ Macau, ICI CCBS, Macau 999078, Peoples R China
[3] Univ Copenhagen, DK-1172 Copenhagen, Denmark
[4] LUT Univ, Lappeenranta 53850, Finland
基金
芬兰科学院; 欧盟地平线“2020”;
关键词
Affective computing; emotion classification; FNIRS; functional near-infrared spectroscopy; pattern classification; signal processing; FRONTAL EEG ASYMMETRY; ACTIVATION; HISTORY; CORTEX; FNIRS;
D O I
10.1109/TAFFC.2023.3315971
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a dataset for the analysis of human affective states using functional near-infrared spectroscopy (fNIRS). Data were recorded from thirty-one participants who engaged in two tasks. In the emotional perception task the participants passively viewed images sampled from the standard international affective picture system database, which provided ground-truth valence and arousal annotation for the stimuli. In the affective imagery task the participants actively imagined emotional scenarios followed by rating these for subjective valence and arousal. Correlates between the fNIRS signal and the valence-arousal ratings were investigated to estimate the validity of the dataset. Source-code and summaries are provided for a processing pipeline, brain activity group analysis, and estimating baseline classification performance. For classification, prediction experiments are conducted for single-trial 4-class classification of arousal and valence as well as cross-participant classifications, and comparisons between high and low arousal variants of the valence prediction tasks. Finally, classification results are presented for subject-specific and cross-participant models. The dataset is made publicly available to encourage research on affective decoding and downstream applications using fNIRS data.
引用
收藏
页码:1166 / 1177
页数:12
相关论文
共 50 条
  • [11] A New Signal Analysis Method for Functional Near-Infrared Spectroscopy
    Zhang Zhongpeng
    Hong Wenxue
    PROCEEDINGS OF 2016 8TH IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN 2016), 2016, : 100 - 106
  • [12] Detecting Concealed Information Using Functional Near-Infrared Spectroscopy
    Sai, Liyang
    Zhou, Xiaomei
    Ding, Xiao Pan
    Fu, Genyue
    Sang, Biao
    BRAIN TOPOGRAPHY, 2014, 27 (05) : 652 - 662
  • [13] On fractality of functional near-infrared spectroscopy signals: analysis and applications
    Zhu, Li
    Haghani, Sasan
    Najafizadeh, Laleh
    NEUROPHOTONICS, 2020, 7 (02)
  • [14] Prosodic influence in face emotion perception: evidence from functional near-infrared spectroscopy
    Becker, Katherine M.
    Rojas, Donald C.
    SCIENTIFIC REPORTS, 2020, 10 (01)
  • [15] Prosodic influence in face emotion perception: evidence from functional near-infrared spectroscopy
    Katherine M. Becker
    Donald C. Rojas
    Scientific Reports, 10
  • [16] Auditory cortex activation is modulated by emotion: A functional near-infrared spectroscopy (fNIRS) study
    Plichta, M. M.
    Gerdes, A. B. M.
    Alpers, G. W.
    Harnisch, W.
    Brill, S.
    Wieser, M. J.
    Fallgatter, A. J.
    NEUROIMAGE, 2011, 55 (03) : 1200 - 1207
  • [17] FOLIAR ANALYSIS USING NEAR-INFRARED REFLECTANCE SPECTROSCOPY
    WESSMAN, CA
    ABER, JD
    PETERSON, DL
    MELILLO, JM
    CANADIAN JOURNAL OF FOREST RESEARCH, 1988, 18 (01) : 6 - 11
  • [18] FEED ANALYSIS USING NEAR-INFRARED REFLECTANCE SPECTROSCOPY
    COLEMAN, SW
    1989 CALIFORNIA ANIMAL NUTRITION CONFERENCE, 1989, : 54 - 71
  • [19] Concurrent Spatiotemporal Analysis of Functional Near-Infrared Spectroscopy Data Using Independent Component Analysis
    Yuan, Zhen
    2013 6TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), VOLS 1-3, 2013, : 794 - 798
  • [20] Interpolated functional manifold for functional near-infrared spectroscopy analysis at group level
    Avila-Sansores, Shender-Maria
    Rodriguez-Gomez, Gustavo
    Tachtsidis, Ilias
    Orihuela-Espina, Felipe
    NEUROPHOTONICS, 2020, 7 (04)