Harnessing Haptic Technology for Real-Time Emotion Detection

被引：0
|
作者：
Levy, Lital [1 ]
Blum, Yuval [1 ]
Ambaw, Asmare [1 ]
Yozevitch, Roi [2 ]
Holdengreber, Eldad [1 ]
机构：
[1] Ariel Univ, Dept Mech Engn & Mechatron, IL-40700 Ariel, Israel
[2] Ariel Univ, Dept Comp & Software Engn, IL-40700 Ariel, Israel
来源：
IEEE SENSORS LETTERS | 2025年 / 9卷 / 03期
关键词：
Emotion recognition; Vibrations; Real-time systems; Haptic interfaces; Visualization; Accuracy; Motors; Face recognition; Speech recognition; Glass; Sensor systems; emotion recognition; facial expression recognition (FER); haptic feedback; machine learning (ML); sensory substitution; speech emotion recognition (SER);
D O I：
10.1109/LSENS.2025.3538804
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
This letter introduces a novel multi-modal environmental translator for real-time emotion recognition. The system integrates facial expression recognition (FER) and speech emotion recognition (SER) to analyze visual and vocal cues while conveying emotional feedback through vibrotactile signals. Emotions are mapped to distinct vibration frequencies-ranging from 0.4 Hz for neutral to 35 Hz for anger-enabling users to identify seven core emotions through tactile sensations intuitively. A user study involving ten participants demonstrated an average adaptation time of fewer than 7 min, indicating the system's effectiveness in quickly familiarizing users with the vibration signals. Overall, this innovative solution provides a robust approach to enhancing real-time emotion recognition through haptic feedback, making it suitable for everyday social interactions.
引用
收藏
页数：4
相关论文
共 50 条
  • [1] Authentic emotion detection in real-time video
    Sun, YF
    Sebe, N
    Lew, MS
    Gevers, T
    COMPUTER VISION IN HUMAN-COMPUTER INTERACTION, PROCEEDINGS, 2004, 3058 : 94 - 104
  • [2] Technology for Real-Time Detection of Microbes in Water
    Furuya, Masashi
    Obara, Daisuke
    Masumoto, Shingo
    Matsuura, Yuho
    Jige, Hisaya
    Hasegawa, Norio
    Hosoi, Tomoki
    2018 57TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2018, : 1679 - 1684
  • [3] Signaletic, haptic and real-time material
    Thomsen, Bodil Marie Stavning
    JOURNAL OF AESTHETICS & CULTURE, 2012, 4 (01):
  • [4] Facial Expression Emotion Detection for Real-Time Embedded Systems
    Turabzadeh, Saeed
    Meng, Hongying
    Swash, Rafiq M.
    Pleva, Matus
    Juhar, Jozef
    TECHNOLOGIES, 2018, 6 (01)
  • [5] SVM Point-based Real-time Emotion Detection
    Swinkels, Wout
    Claesen, Luc
    Xiao, Feng
    Shen, Haibin
    2017 IEEE CONFERENCE ON DEPENDABLE AND SECURE COMPUTING, 2017, : 86 - 92
  • [6] Real-time emotion detection by quantitative facial motion analysis
    Saadon, Jordan R.
    Yang, Fan
    Burgert, Ryan
    Mohammad, Selma
    Gammel, Theresa
    Sepe, Michael
    Rafailovich, Miriam
    Mikell, Charles B.
    Polak, Pawel
    Mofakham, Sima
    PLOS ONE, 2023, 18 (03):
  • [7] Real-time emotion detection by quantitative facial motion analysis
    Saadon, Jordan R.
    Yang, Fan
    Burgert, Ryan
    Mohammad, Selma
    Gammel, Theresa
    Sepe, Michael
    Rafailovich, Miriam
    Mikell, Charles B.
    Polak, Pawel
    Mofakham, Sima
    PLOS BIOLOGY, 2023, 21 (03)
  • [8] Physiological feedback technology for real-time emotion regulation: a systematic review
    Sun, Yifan
    Lu, Tian
    Wang, Xuanyi
    Chen, Wanlin
    Chen, Shulin
    Chen, Hang
    Zheng, Jing
    FRONTIERS IN PSYCHOLOGY, 2023, 14
  • [9] Robust real-time emotion detection system using CNN architecture
    Jaiswal, Shruti
    Nandi, G. C.
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (15): : 11253 - 11262
  • [10] An Efficient Real-Time Emotion Detection Using Camera and Facial Landmarks
    Nguyen, Binh T.
    Trinh, Minh H.
    Phan, Tan V.
    Nguyen, Hien D.
    2017 SEVENTH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST2017), 2017, : 251 - 255
12345