Harnessing Haptic Technology for Real-Time Emotion Detection

被引:0
|
作者
Levy, Lital [1 ]
Blum, Yuval [1 ]
Ambaw, Asmare [1 ]
Yozevitch, Roi [2 ]
Holdengreber, Eldad [1 ]
机构
[1] Ariel Univ, Dept Mech Engn & Mechatron, IL-40700 Ariel, Israel
[2] Ariel Univ, Dept Comp & Software Engn, IL-40700 Ariel, Israel
关键词
Emotion recognition; Vibrations; Real-time systems; Haptic interfaces; Visualization; Accuracy; Motors; Face recognition; Speech recognition; Glass; Sensor systems; emotion recognition; facial expression recognition (FER); haptic feedback; machine learning (ML); sensory substitution; speech emotion recognition (SER);
D O I
10.1109/LSENS.2025.3538804
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This letter introduces a novel multi-modal environmental translator for real-time emotion recognition. The system integrates facial expression recognition (FER) and speech emotion recognition (SER) to analyze visual and vocal cues while conveying emotional feedback through vibrotactile signals. Emotions are mapped to distinct vibration frequencies-ranging from 0.4 Hz for neutral to 35 Hz for anger-enabling users to identify seven core emotions through tactile sensations intuitively. A user study involving ten participants demonstrated an average adaptation time of fewer than 7 min, indicating the system's effectiveness in quickly familiarizing users with the vibration signals. Overall, this innovative solution provides a robust approach to enhancing real-time emotion recognition through haptic feedback, making it suitable for everyday social interactions.
引用
收藏
页数:4
相关论文
共 50 条
  • [31] Real-time haptic and visual simulation of bone dissection
    Agus, M
    Giachetti, A
    Gobbetti, E
    Zanetti, G
    Zorcolo, A
    IEEE VIRTUAL REALITY 2002, PROCEEDINGS, 2002, : 209 - 216
  • [32] Real-time haptic interaction with RGBD video streams
    Shahzad Rasool
    Alexei Sourin
    The Visual Computer, 2016, 32 : 1311 - 1321
  • [33] A Real-Time Haptic Interface for Interventional Radiology Procedures
    Moix, Thomas
    Ilic, Dejan
    Fracheboud, Blaise
    Zoethout, Jurjen
    Bleuler, Hannes
    MEDICINE MEETS VIRTUAL REALITY 13: THE MAGICAL NEXT BECOMES THE MEDICAL NOW, 2005, 111 : 329 - 333
  • [34] Multirate output estimation for real-time haptic rendering
    Lee, Kyungno
    Lee, Doo Yong
    2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-10, 2006, : 3312 - +
  • [35] Real-time Personal Identification based on Haptic Information
    Tsuji, Toshiaki
    Arakawa, Junichi
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011, : 1354 - 1359
  • [36] A precomputed approach for real-time haptic interaction with fluids
    Dobashi, Yoshinori
    Yamamoto, Tsuyoshi
    Sato, Makoto
    Hasegawa, Shoichi
    Kato, Mitsuaki
    Nishita, Tomoyuki
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2007, 27 (03) : 90 - 92
  • [37] Real-time haptic and visual simulation of bone dissection
    Agus, M
    Giachetti, A
    Gobbetti, E
    Zanetti, G
    Zorcolo, A
    PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2003, 12 (01) : 110 - 122
  • [38] Real-time Detection for Multiple Occupancy and Near Real-time Hogging Detection
    Huy, Nguyen Huy Hoang
    Balan, Rajesh Krishna
    Lee, Youngki
    SenSys'15: Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems, 2015, : 477 - 478
  • [39] The Application of Real-time Imaging Detection Technology in the Detection of Aluminum Casting Parts
    Yang, Yu
    Chen, Dong
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND MANAGEMENT INNOVATION, 2015, 28 : 887 - 890
  • [40] Real-Time Haptic Interface for VR Colonoscopy Simulation
    Ilic, Dejan
    Moix, Thomas
    Mc Cullough, Nial
    Duratti, Lindo
    Vecerina, Ivan
    Bleulera, Hannes
    MEDICINE MEETS VIRTUAL REALITY 13: THE MAGICAL NEXT BECOMES THE MEDICAL NOW, 2005, 111 : 208 - 212