Multimodal Affect Recognition in Virtual Worlds: Avatars Mirroring Users' Affect

被引:0
|
作者
Gonzalez-Sanchez, Javier [1 ]
Chavez-Echeagaray, Maria Elena [1 ]
Gibson, David [2 ]
Atkinson, Robert [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85287 USA
[2] Curtin Univ, Perth, WA, Australia
关键词
affect recognition; affect mirroring; virtual worlds; second life; multimodal; framework; MODEL;
D O I
10.1109/ACII.2013.133
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Virtual worlds enable users' interactions through avatars. Avatars embody individual characteristics from their owners and exhibit those characteristics outward to the community. Motivated by the role of avatars in interpersonal communication, we integrated a generic real-time multimodal affect recognition hub as an input within an online virtual world to make an avatar mirror its owner's affect. Affect vectors (determined by pleasure, arousal, and dominance coordinates) in a continuous affective space are applied to characterize the user's affective state in real time.
引用
收藏
页码:724 / +
页数:2
相关论文
共 50 条
  • [21] Avatars and virtual worlds: Unsettling the rules of porn
    Picarra, Elizabeth
    AGENDA-EMPOWERING WOMEN FOR GENDER EQUITY, 2012, 26 (03): : 19 - 30
  • [22] Virtual worlds and avatars as new education forms
    Poveda Criado, Miguel Angel
    Thous Tuset, Ma del Carmen
    HISTORIA Y COMUNICACION SOCIAL, 2013, 18
  • [23] MULTIMODAL SOCIAL BRAIN NETWORK AND FACIAL AFFECT RECOGNITION IN SCHIZOPHRENIA
    Koevoets, Martijn
    de Nijs, Jessica
    Kahn, Rene
    Cahn, Wiepke
    van Haren, Neeltje
    SCHIZOPHRENIA BULLETIN, 2017, 43 : S192 - S192
  • [24] Communicative Signals and Social Contextual Factors in Multimodal Affect Recognition
    Jansen, Michel-Pierre
    ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, : 468 - 472
  • [25] Validation of dynamic virtual faces for facial affect recognition
    Fernandez-Sotos, Patricia
    Garcia, Arturo S.
    Vicente-Querol, Miguel A.
    Lahera, Guillermo
    Rodriguez-Jimenez, Roberto
    Fernandez-Caballero, Antonio
    PLOS ONE, 2021, 16 (01):
  • [26] Multimodal Affect Recognition Using Temporal Convolutional Neural Networks
    Ayoub, Issa
    Heiries, Vincent
    Al Osman, Hussein
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [27] Multimodal Virtual Avatars for Investigative Interviews with Children
    Baugerud, Gunn Astrid
    Johnson, Miriam S.
    Roed, Ragnhild Klingenberg
    Lamb, Michael E.
    Powell, Martine
    Thambawita, Vajira
    Hicks, Steven A.
    Salehi, Pegah
    Hassan, Syed Zohaib
    Halvorsen, Pal
    Riegler, Michael A.
    ICDAR '21: PROCEEDINGS OF THE 2021 WORKSHOP ON INTELLIGENT CROSS-DATA ANALYSIS AND RETRIEVAL, 2021, : 2 - 8
  • [28] Affect in Multimodal Information
    Esposito, Anna
    AFFECTIVE INFORMATION PROCESSING, 2009, : 203 - 226
  • [29] Emotionally Responsive Robotic Avatars as Characters in Virtual Worlds
    Slater, Stuart
    Burden, David
    PROCEEDINGS OF THE IEEE VIRTUAL WORLDS FOR SERIOUS APPLICATIONS, 2009, : 12 - +
  • [30] Technologies of the Virtual Other Bodies, Users, and Avatars
    Canizares, Galo
    JOURNAL OF ARCHITECTURAL EDUCATION, 2020, 74 (02) : 237 - 249