Harnessing Haptic Technology for Real-Time Emotion Detection

被引：0

作者：

Levy, Lital ^{[1
]}

Blum, Yuval ^{[1
]}

Ambaw, Asmare ^{[1
]}

Yozevitch, Roi ^{[2
]}

Holdengreber, Eldad ^{[1
]}

机构：

[1] Ariel Univ, Dept Mech Engn & Mechatron, IL-40700 Ariel, Israel

[2] Ariel Univ, Dept Comp & Software Engn, IL-40700 Ariel, Israel

来源：

IEEE SENSORS LETTERS | 2025年 / 9卷 / 03期

关键词：

Emotion recognition; Vibrations; Real-time systems; Haptic interfaces; Visualization; Accuracy; Motors; Face recognition; Speech recognition; Glass; Sensor systems; emotion recognition; facial expression recognition (FER); haptic feedback; machine learning (ML); sensory substitution; speech emotion recognition (SER);

D O I：

10.1109/LSENS.2025.3538804

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

This letter introduces a novel multi-modal environmental translator for real-time emotion recognition. The system integrates facial expression recognition (FER) and speech emotion recognition (SER) to analyze visual and vocal cues while conveying emotional feedback through vibrotactile signals. Emotions are mapped to distinct vibration frequencies-ranging from 0.4 Hz for neutral to 35 Hz for anger-enabling users to identify seven core emotions through tactile sensations intuitively. A user study involving ten participants demonstrated an average adaptation time of fewer than 7 min, indicating the system's effectiveness in quickly familiarizing users with the vibration signals. Overall, this innovative solution provides a robust approach to enhancing real-time emotion recognition through haptic feedback, making it suitable for everyday social interactions.

引用

页数：4

共 50 条

[21] A Real-time Anomalies Detection System based on Streaming Technology
Du, Yutan
Liu, Jun
Liu, Fang
Chen, Luying
2014 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL 2, 2014, : 275 - 279
[22] Demo Abstract: Real-Time Emotion Detection via E-See
Gu, Weixi
Zhang, Yue
Ma, Fei
Mosalam, Khalid
Zhang, Lin
Ni, Shiguang
SENSYS'18: PROCEEDINGS OF THE 16TH CONFERENCE ON EMBEDDED NETWORKED SENSOR SYSTEMS, 2018, : 420 - 421
[23] A Novel Real-Time Emotion Detection System for Advanced Driver Assistance Systems
Al Machot, Fadi
Mosa, Ahmad Haj
Fasih, Alireza
Schwarzlmueller, Christopher
Ali, Mouhanndad
Kyamakya, Kyandoghere
AUTONOMOUS SYSTEMS: DEVELOPMENTS AND TRENDS, 2011, 391 : 267 - 276
[24] Real-time physiological emotion detection mechanisms: Effects of exercise and affect intensity
Leon, E.
Clarke, G.
Sepulveda, F.
Callaghan, V.
2005 27TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-7, 2005, : 4719 - 4722
[25] Real-time Haptic Rendering and Haptic Telepresence Robotic System for the Visually Impaired
Park, Chung Hyuk
Howard, Ayanna M.
2013 WORLD HAPTICS CONFERENCE (WHC), 2013, : 229 - 234
[26] Real-Time Feedback for Children's Pre-Writing Activities Using Haptic Technology
Aminordin, Muhammad Amir Azwan Mohamad
Adam, Noor Latiffah
Diah, Norizan Mat
2017 IEEE 13TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA), 2017, : 153 - 158
[27] Real-time volumetric haptic and visual burrhole simulation
Acosta, Eric
Liu, Alan
IEEE VIRTUAL REALITY 2007, PROCEEDINGS, 2007, : 247 - +
[28] Real-Time Haptic Simulation of Soft Tissue Deformation
Sadraei, Ehsan
Moghaddam, Majid M.
Moazzen, Mohamad H.
Sijani, Faeze Sayad
2014 SECOND RSI/ISM INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2014, : 53 - 58
[29] Real-time haptic interaction with RGBD video streams
Rasool, Shahzad
Sourin, Alexei
VISUAL COMPUTER, 2016, 32 (10): : 1311 - 1321
[30] Real-time Estimation of Human Impedance for Haptic Interfaces
Hill, Matthew D.
Niemeyer, Guenter
WORLD HAPTICS 2009: THIRD JOINT EUROHAPTICS CONFERENCE AND SYMPOSIUM ON HAPTIC INTERFACES FOR VIRTUAL ENVIRONMENT AND TELEOPERATOR SYSTEMS, PROCEEDINGS, 2009, : 440 - 445

← 1 2 3 4 5 →