Motion recognition of self and others on realistic 3D avatars

被引:20
|
作者
Narang, Sahil [1 ,3 ]
Best, Andrew [3 ]
Feng, Andrew [1 ]
Kang, Sin-hwa [1 ]
Manocha, Dinesh [4 ]
Shapiro, Ari [2 ]
机构
[1] Univ Southern Calif, Inst Creat Technol, Los Angeles, CA USA
[2] Univ Southern Calif, Inst Creat Technol, Animat & Simulat Res Grp, Los Angeles, CA USA
[3] Univ N Carolina, Chapel Hill, NC 27599 USA
[4] Univ N Carolina, Comp Sci, Chapel Hill, NC USA
基金
美国国家科学基金会;
关键词
animation; avatar; gaint; perception; virtual reality; BIOLOGICAL MOTION; PERCEPTION;
D O I
10.1002/cav.1762
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Current 3D capture and modeling technology can rapidly generate highly photo-realistic 3D avatars of human subjects. However, while the avatars look like their human counterparts, their movements often do not mimic their own due to existing challenges in accurate motion capture and retargeting. A better understanding of factors that influence the perception of biological motion would be valuable for creating virtual avatars that capture the essence of their human subjects. To investigate these issues, we captured 22 subjects walking in an open space. We then performed a study where participants were asked to identify their own motion in varying visual representations and scenarios. Similarly, participants were asked to identify the motion of familiar individuals. Unlike prior studies that used captured footage with simple point-light displays, we rendered the motion on photo-realistic 3D virtual avatars of the subject. We found that self-recognition was significantly higher for virtual avatars than with point-light representations. Users were more confident of their responses when identifying their motion presented on their virtual avatar. Recognition rates varied considerably between motion types for recognition of others, but not for self-recognition. Overall, our results are consistent with previous studies that used recorded footage and offer key insights into the perception of motion rendered on virtual avatars.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] 3D text segmentation and recognition using leap motion
    Kumar, Pradeep
    Saini, Rajkumar
    Roy, Partha Pratim
    Dogra, Debi Prosad
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (15) : 16491 - 16510
  • [32] Pattern recognition in 3D automatic human motion analysis
    Ferrigno, G.
    Borghese, N.A.
    Pedotti, A.
    FWP Journal, 1990,
  • [33] Enhanced real-time motion transfer to 3D avatars using RGB-based human 3D pose estimation
    Poulios, Ilias
    Pistola, Theodora
    Symeonidis, Spyridon
    Diplaris, Sotiris
    Ioannidis, Konstantinos
    Vrochidis, Stefanos
    Kompatsiaris, Ioannis
    PROCEEDINGS OF THE 2024 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE MEDIA EXPERIENCES WORKSHOPS, IMXW 2024, 2024, : 88 - 99
  • [34] On Double-level Kernel Self-similarities for 3D Motion Trajectory Description and Recognition
    Guo, Yao
    Li, Youfu
    Shao, Zhanpeng
    2017 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (RCAR), 2017, : 657 - 662
  • [35] XAGen: 3D Expressive Human Avatars Generation
    Xu, Zhongcong
    Zhang, Jianfeng
    Liew, Jun Hao
    Feng, Jiashi
    Shou, Mike Zheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [36] Facial Synthesis of 3D Avatars for Therapeutic Applications
    Orvalho, Veronica
    Miranda, Jose
    Sousa, A. Augusto
    CYBERPSYCHOLOGY & BEHAVIOR, 2009, 12 (05): : 643 - 644
  • [37] Facial Synthesys of 3D Avatars for Therapeutic Applications
    Orvalho, Veronica
    Miranda, Jose
    Sousa, Augusto
    ANNUAL REVIEW OF CYBERTHERAPY AND TELEMEDICINE, 2009, 7 : 96 - 98
  • [38] VR Karaoke Using Expressive 3D Avatars
    Choi, JaeHyeok
    Chong, Jonggwun
    Lee, Woojin
    Lee, WonHyong
    ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS 6, 2022, 429 : 543 - 552
  • [39] Self recognition versus recognition of others by biological motion: Viewpoint-dependent effects
    Jokisch, Daniel
    Daum, Irene
    Troje, Nikolaus F.
    PERCEPTION, 2006, 35 (07) : 911 - 920
  • [40] Structured 3D Features for Reconstructing Controllable Avatars
    Corona, Enric
    Zanfir, Mihai
    Alldieck, Thiemo
    Bazavan, Eduard Gabriel
    Zanfir, Andrei
    Sminchisescu, Cristian
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16954 - 16964