Manga content analysis using physiological signals

被引:4
|
作者
Sanches, Charles Lima [1 ]
Augereau, Olivier [1 ]
Kise, Koichi [1 ]
机构
[1] Osaka Prefecture Univ, Naka Ku, 1-1 Gakuen Cho, Sakai, Osaka 5998531, Japan
关键词
Manga retrieval; Physiological signals; Emotion recognition;
D O I
10.1145/3011549.3011555
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the physiological signals have been analyzed more and more, especially in the context of everyday life activities such as watching video or looking at pictures. Tracking these signals gives access to the mental state of the user (interest, tiredness, stress) but also to his emotions (sadness, fright, happiness). The analysis of the reader's physiological signals during reading can provide a better understanding of the reader's feelings but also a better understanding of the documents. Our main research direction is to find the relationship between a change in the reader's physiological signal and the content of the reading. As a first step, we investigate whether it is possible to distinguish a manga (Japanese comic book) from another by analyzing the physiological signals of the reader. We use 3 different manga genres (horror, romance, comedy) and try to predict which one is read by analyzing the features extracted from the physiological signals of the reader. Our method uses the blood volume pulse, the electrodermal activity and the skin temperature of the reader while reading. We show that by using these physiological signals with a support vector machine we can retrieve which manga has been read with a 90% average accuracy.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Analysis and classification of physiological signals using wavelet transforms
    Jacobson, ML
    [J]. ICECS 2003: PROCEEDINGS OF THE 2003 10TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS, VOLS 1-3, 2003, : 906 - 909
  • [2] DEAP: A Database for Emotion Analysis Using Physiological Signals
    Koelstra, Sander
    Muhl, Christian
    Soleymani, Mohammad
    Lee, Jong-Seok
    Yazdani, Ashkan
    Ebrahimi, Touradj
    Pun, Thierry
    Nijholt, Anton
    Patras, Ioannis
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) : 18 - 31
  • [3] Self-Injury in Japanese Manga: A Content Analysis
    Yukari Seko
    Minako Kikuchi
    [J]. Journal of Medical Humanities, 2021, 42 : 355 - 369
  • [4] Self-Injury in Japanese Manga: A Content Analysis
    Seko, Yukari
    Kikuchi, Minako
    [J]. JOURNAL OF MEDICAL HUMANITIES, 2021, 42 (03) : 355 - 369
  • [5] Evaluation of Stress Reduction Effects Using Physiological Indexes in Manga Reading
    Kurihara, Souta
    Feng, Chen
    Sugaya, Midori
    [J]. HCI INTERNATIONAL 2024 POSTERS, PT V, HCII 2024, 2024, 2118 : 360 - 367
  • [6] Morphology analysis of physiological signals using hidden Markov models
    Novák, D
    Lhotská, L
    Hamam, TAY
    Cuesta-Frau, D
    Micó, P
    Aboy, M
    [J]. PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, 2004, : 754 - 757
  • [7] Preliminary Evaluation of Manga's Emotional Impact Using Physiological Indexes
    Hiraide, Tatsuhiro
    Feng, Chen
    Sugaya, Midori
    [J]. HCI INTERNATIONAL 2024 POSTERS, PT I, HCII 2024, 2024, 2114 : 268 - 277
  • [8] Statistical analysis of physiological signals
    Ruiz, MG
    Pérez, L
    [J]. INSTRUMENTATION IN ELEMENTARY PARTICLE PHYSICS, 2003, 674 : 336 - 343
  • [9] Analysis of Physiological Signals in Response to Stress using ECG and Respiratory Signals of Automobile Drivers.
    Soman, Karthik
    Alex, Varghese
    Srinivas, Chaithanya
    [J]. 2013 IEEE INTERNATIONAL MULTI CONFERENCE ON AUTOMATION, COMPUTING, COMMUNICATION, CONTROL AND COMPRESSED SENSING (IMAC4S), 2013, : 574 - 579
  • [10] CHAMPS: Cardiac health Hypergraph Analysis using Multimodal Physiological Signals
    Choudhury, Anirban Dutta
    Chowdhury, Ananda S.
    [J]. 2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 4640 - 4645