Neural correlates of affective content: application to perceptual tagging of video

被引:0
|
作者
Shanu Sharma
Ashwani Kumar Dubey
Priya Ranjan
Alvaro Rocha
机构
[1] Amity University Uttar Pradesh,Amity School of Engineering and Technology
[2] SRM University,Department of Electronics and Communication Engineering
[3] University of Lisbon,ISEG
来源
Neural Computing and Applications | 2023年 / 35卷
关键词
Affective content; Video tagging; EEG signals; Brain–computer interface (BCI);
D O I
暂无
中图分类号
学科分类号
摘要
Over the past years, a digital multimedia uprising has been experienced in every walk of life, due to which the un-annotated or unstructured multimedia content has always been a key issue for research. The multimedia content is usually created with some intended emotions, which the creator wants to induce in viewers. The affectiveness of the multimedia content can be measured by analyzing elicited emotions of its viewers. In this paper, we present a rigorous study of human cognition using EEG signals while watching a video, to analyze the affectiveness of video content. The analysis presented in this paper is done to establish an effective relationship between video content and the human emotional state. For this, the most effective scalp location and frequency ranges are identified for two categories of videos, i.e., excited and sad. Furthermore, a common affective response (CAR) is extracted for finding the distinguishable features for aforementioned categories of videos. The CAR is calculated and tested on the publicly available dataset “AMIGOS,” and the results presented here show the utility of cognitive features on extracted scalp locations and frequency ranges for automatic tagging of video content. The current research explores the innovative applicability of neuro-signals for a mouse-free video tagging based on human excitement level to augment a range of brain–computer interface (BCI)-based devices. It can further aid to automatically retrieve the video content which is exciting and interesting to human viewers. With this analysis, we aimed to provide a thorough analysis which can be used to customize a low-cost and mobile EEG system for automatic analysis and retrieval of videos.
引用
收藏
页码:7925 / 7941
页数:16
相关论文
共 50 条
  • [1] Neural correlates of affective content: application to perceptual tagging of video
    Sharma, Shanu
    Dubey, Ashwani Kumar
    Ranjan, Priya
    Rocha, Alvaro
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11): : 7925 - 7941
  • [2] A deep perceptual framework for affective video tagging through multiband EEG signals modeling
    Sharma, Shanu
    Dubey, Ashwani Kumar
    Ranjan, Priya
    Rocha, Alvaro
    NEURAL COMPUTING & APPLICATIONS, 2023, 37 (11): : 7657 - 7674
  • [3] Content Redundancy in YouTube and Its Application to Video Tagging
    San Pedro, Jose
    Siersdorfer, Stefan
    Sanderson, Mark
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2011, 29 (03)
  • [4] Perceptual Video Content Analysis and Application to HEVC Quantization Refinement
    Rouis, Kais
    Larabi, Mohamed-Chaker
    PROCEEDINGS OF THE 2018 7TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2018,
  • [5] Implicit Affective Video Tagging Using Pupillary Response
    Gui, Dongdong
    Zhong, Sheng-Hua
    Ming, Zhong
    MULTIMEDIA MODELING, MMM 2018, PT II, 2018, 10705 : 165 - 176
  • [6] Automatic Video Tagging using Content Redundancy
    Siersdorfer, Stefan
    Pedro, Jose San
    Sanderson, Mark
    PROCEEDINGS 32ND ANNUAL INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2009, : 395 - 402
  • [7] On the perceptual and neural correlates of reading models
    Osaka, N
    BEHAVIORAL AND BRAIN SCIENCES, 2003, 26 (04) : 495 - +
  • [8] Neural Correlates of Multisensory Perceptual Learning
    Powers, Albert R., III
    Hevey, Matthew A.
    Wallace, Mark T.
    JOURNAL OF NEUROSCIENCE, 2012, 32 (18): : 6263 - 6274
  • [9] NEURAL CORRELATES OF OLFACTORY PERCEPTUAL SHIFTS
    Conway, Mark
    Oncul, Merve
    Johnston, Jamie
    CHEMICAL SENSES, 2023, 48
  • [10] NEURAL CORRELATES OF PERCEPTUAL MOTION COHERENCE
    STONER, GR
    ALBRIGHT, TD
    NATURE, 1992, 358 (6385) : 412 - 414