Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring Users' Affect

被引:0
|
作者
Gonzalez-Sanchez, Javier [1 ]
Chavez-Echeagaray, Maria Elena [1 ]
Gibson, David [2 ]
Atkinson, Robert [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85287 USA
[2] Curtin Univ, Perth, WA, Australia
关键词
affect recognition; affect mirroring; virtual worlds; second life; multimodal; framework; MODEL;
D O I
10.1109/ACII.2013.133
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Virtual worlds enable users' interactions through avatars. Avatars embody individual characteristics from their owners and exhibit those characteristics outward to the community. Motivated by the role of avatars in interpersonal communication, we integrated a generic real-time multimodal affect recognition hub as an input within an online virtual world to make an avatar mirror its owner's affect. Affect vectors (determined by pleasure, arousal, and dominance coordinates) in a continuous affective space are applied to characterize the user's affective state in real time.
引用
收藏
页码:724 / +
页数:2
相关论文
共 50 条
  • [31] Multimodal interaction with virtual worlds XMMVR: eXtensible language for MultiModal interaction with virtual reality worlds
    Olmedo, Hector
    Escudero, David
    Cardenoso, Valentin
    JOURNAL ON MULTIMODAL USER INTERFACES, 2015, 9 (03) : 153 - 172
  • [32] Multimodal interaction with virtual worlds XMMVR: eXtensible language for MultiModal interaction with virtual reality worlds
    Hector Olmedo
    David Escudero
    Valentín Cardeñoso
    Journal on Multimodal User Interfaces, 2015, 9 : 153 - 172
  • [33] Avatars, People, and Virtual Worlds: Foundations for Research in Metaverses
    Davis, Alanah
    Khazanchi, Deepak
    Murphy, John
    Zigurs, Ilze
    Owens, Dawn
    JOURNAL OF THE ASSOCIATION FOR INFORMATION SYSTEMS, 2009, 10 (02): : 90 - 117
  • [34] The Political Lives of Avatars Play and Democracy in Virtual Worlds
    Lau, Kimberly J.
    WESTERN FOLKLORE, 2010, 69 (3-4) : 369 - 394
  • [35] Virtual Worlds and Avatars as the New Frontier of Telehealth Care
    Morie, J.
    Haynes, E.
    Chance, E.
    Purohit, D.
    ANNUAL REVIEW OF CYBERTHERAPY AND TELEMEDICINE, 2012, 10 : 27 - 31
  • [36] Avatars' Appearance and Social Behavior in Online Virtual Worlds
    Banakou, Domna
    Chorianopoulos, Konstantinos
    Anagnostou, Kostas
    13TH PANHELLENIC CONFERENCE ON INFORMATICS, PROCEEDINGS, 2009, : 207 - 211
  • [37] Multimodal spontaneous affect recognition using neural networks learned with hints
    Lü, K. (kunlv@bit.edu.cn), 1600, Beijing Institute of Technology (23):
  • [38] Multimodal spontaneous affect recognition using neural networks learned with hints
    张欣
    吕坤
    JournalofBeijingInstituteofTechnology, 2014, 23 (01) : 117 - 125
  • [39] Multimodal Continuous Affect Recognition Based on LSTM and Multiple Kernel Learning
    Wei, Jiamei
    Pei, Ercheng
    Jiang, Dongmei
    Sahli, Hichem
    Xie, Lei
    Fu, Zhonghua
    2014 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2014,
  • [40] Perceptual biases for multimodal cues in chimpanzee (Pan troglodytes) affect recognition
    Parr, LA
    ANIMAL COGNITION, 2004, 7 (03) : 171 - 178