Neural correlates of affective content: application to perceptual tagging of video

被引:0
|
作者
Shanu Sharma
Ashwani Kumar Dubey
Priya Ranjan
Alvaro Rocha
机构
[1] Amity University Uttar Pradesh,Amity School of Engineering and Technology
[2] SRM University,Department of Electronics and Communication Engineering
[3] University of Lisbon,ISEG
来源
Neural Computing and Applications | 2023年 / 35卷
关键词
Affective content; Video tagging; EEG signals; Brain–computer interface (BCI);
D O I
暂无
中图分类号
学科分类号
摘要
Over the past years, a digital multimedia uprising has been experienced in every walk of life, due to which the un-annotated or unstructured multimedia content has always been a key issue for research. The multimedia content is usually created with some intended emotions, which the creator wants to induce in viewers. The affectiveness of the multimedia content can be measured by analyzing elicited emotions of its viewers. In this paper, we present a rigorous study of human cognition using EEG signals while watching a video, to analyze the affectiveness of video content. The analysis presented in this paper is done to establish an effective relationship between video content and the human emotional state. For this, the most effective scalp location and frequency ranges are identified for two categories of videos, i.e., excited and sad. Furthermore, a common affective response (CAR) is extracted for finding the distinguishable features for aforementioned categories of videos. The CAR is calculated and tested on the publicly available dataset “AMIGOS,” and the results presented here show the utility of cognitive features on extracted scalp locations and frequency ranges for automatic tagging of video content. The current research explores the innovative applicability of neuro-signals for a mouse-free video tagging based on human excitement level to augment a range of brain–computer interface (BCI)-based devices. It can further aid to automatically retrieve the video content which is exciting and interesting to human viewers. With this analysis, we aimed to provide a thorough analysis which can be used to customize a low-cost and mobile EEG system for automatic analysis and retrieval of videos.
引用
收藏
页码:7925 / 7941
页数:16
相关论文
共 50 条
  • [41] Electroencephalography Amplitude Modulation Analysis for Automated Affective Tagging of Music Video Clips
    Clerico, Andrea
    Tiwari, Abhishek
    Gupta, Rishabh
    Jayaraman, Srinivasan
    Falk, Tiago H.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2018, 11
  • [42] Perceptual correlates of neural representations evoked by odorant enantiomers
    Linster, C
    Johnson, BA
    Yue, E
    Morse, A
    Xu, Z
    Hingco, EE
    Choi, YJ
    Choi, M
    Messiha, A
    Leon, M
    JOURNAL OF NEUROSCIENCE, 2001, 21 (24): : 9837 - 9843
  • [43] Neural correlates of perceptual color inferences as revealed by #thedress
    Retter, Talia L.
    Gwinn, O. Scott
    ONeil, Sean F.
    Jiang, Fang
    Webster, Michael A.
    JOURNAL OF VISION, 2020, 20 (03):
  • [44] Neural correlates of perceptual contributions to nondeclarative memory for faces
    Boehm, SG
    Klostermann, EC
    Paller, KA
    NEUROIMAGE, 2006, 30 (03) : 1021 - 1029
  • [45] Neural correlates of perceptual contributions to implicit memory for faces
    Boehm, SG
    Klostermann, EC
    Paller, KA
    PSYCHOPHYSIOLOGY, 2003, 40 : S27 - S27
  • [46] Neural correlates of evidence accumulation in a perceptual decision task
    Liu, Taosheng
    Pleskac, Timothy J.
    JOURNAL OF NEUROPHYSIOLOGY, 2011, 106 (05) : 2383 - 2398
  • [47] Common and distinct neural correlates of perceptual and memorial selection
    Nee, Derek Evan
    Jonides, John
    NEUROIMAGE, 2009, 45 (03) : 963 - 975
  • [48] EMBODIED LISTENING AND TIMBRE: PERCEPTUAL, ACOUSTICAL, AND NEURAL CORRELATES
    Wallmark, Zachary
    Iacoboni, Marco
    Deblieck, Choi
    Kendall, Roger A.
    MUSIC PERCEPTION, 2018, 35 (03): : 332 - 363
  • [49] Distinguishing the Neural Correlates of Perceptual Awareness and Postperceptual Processing
    Cohen, Michael A.
    Ortego, Kevin
    Kyroudis, Andrew
    Pitts, Michael
    JOURNAL OF NEUROSCIENCE, 2020, 40 (25): : 4925 - 4935
  • [50] Frequency-specific neural signatures of perceptual content and perceptual stability
    Hardstone, Richard
    Flounders, Matthew W.
    Zhu, Michael
    He, Biyu J.
    ELIFE, 2022, 11