Motion recognition of self and others on realistic 3D avatars

被引:20
|
作者
Narang, Sahil [1 ,3 ]
Best, Andrew [3 ]
Feng, Andrew [1 ]
Kang, Sin-hwa [1 ]
Manocha, Dinesh [4 ]
Shapiro, Ari [2 ]
机构
[1] Univ Southern Calif, Inst Creat Technol, Los Angeles, CA USA
[2] Univ Southern Calif, Inst Creat Technol, Animat & Simulat Res Grp, Los Angeles, CA USA
[3] Univ N Carolina, Chapel Hill, NC 27599 USA
[4] Univ N Carolina, Comp Sci, Chapel Hill, NC USA
基金
美国国家科学基金会;
关键词
animation; avatar; gaint; perception; virtual reality; BIOLOGICAL MOTION; PERCEPTION;
D O I
10.1002/cav.1762
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Current 3D capture and modeling technology can rapidly generate highly photo-realistic 3D avatars of human subjects. However, while the avatars look like their human counterparts, their movements often do not mimic their own due to existing challenges in accurate motion capture and retargeting. A better understanding of factors that influence the perception of biological motion would be valuable for creating virtual avatars that capture the essence of their human subjects. To investigate these issues, we captured 22 subjects walking in an open space. We then performed a study where participants were asked to identify their own motion in varying visual representations and scenarios. Similarly, participants were asked to identify the motion of familiar individuals. Unlike prior studies that used captured footage with simple point-light displays, we rendered the motion on photo-realistic 3D virtual avatars of the subject. We found that self-recognition was significantly higher for virtual avatars than with point-light representations. Users were more confident of their responses when identifying their motion presented on their virtual avatar. Recognition rates varied considerably between motion types for recognition of others, but not for self-recognition. Overall, our results are consistent with previous studies that used recorded footage and offer key insights into the perception of motion rendered on virtual avatars.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Body Talk: Crowdshaping Realistic 3D Avatars with Words
    Streuber, Stephan
    Quiros-Ramirez, M. Alejandra
    Hill, Matthew Q.
    Hahn, Carina A.
    Zuffi, Silvia
    O'Toole, Alice
    Black, Michael J.
    ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04):
  • [2] Realtime control for motion creation of 3D avatars
    Kim, DH
    Sung, MY
    Park, JS
    Jun, K
    Lee, SR
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2005, PT 1, 2005, 3767 : 25 - 36
  • [3] Personalizing human avatars based on realistic 3D facial reconstruction
    Ding Y.
    He H.
    Mok P.Y.
    Multimedia Tools and Applications, 2024, 83 (39) : 86593 - 86620
  • [4] Towards the Automatic Generation of 3D Photo-Realistic Avatars Using 3D Scanned Data
    Luginbuehl, Thibault
    Delattre, Laurent
    Gagalowicz, Andre
    COMPUTER VISION/COMPUTER GRAPHICS COLLABORATION TECHNIQUES, MIRAGE 2011, 2011, 6930 : 192 - 203
  • [5] Methods for 3D Sports Motion Analysis and Motion Recognition
    Jing, Jihong
    AGRO FOOD INDUSTRY HI-TECH, 2017, 28 (03): : 2764 - 2768
  • [6] Online motion recognition for 3D human motion with rejection determination
    Cai, Meiling
    Zou, Beiji
    ICIC Express Letters, 2012, 6 (11): : 2739 - 2744
  • [7] Flexible Trajectory Indexing for 3D Motion Recognition
    Yang, Jianyu
    Yuan, Junsong
    Li, Y. F.
    2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, : 326 - 332
  • [8] Parsing 3D motion trajectory for gesture recognition
    Yang, Jianyu
    Yuan, Junsong
    Li, Youfu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 38 : 627 - 640
  • [9] Action recognition with motion map 3D network
    Sun, Yuchao
    Wu, Xinxiao
    Yu, Wennan
    Yu, Feiwu
    NEUROCOMPUTING, 2018, 297 : 33 - 39
  • [10] 3D OBJECT TRACKING AND MOTION SHAPE RECOGNITION
    Amirgaliyev, Y. N.
    Nussipbekov, A. K.
    BULLETIN OF THE NATIONAL ACADEMY OF SCIENCES OF THE REPUBLIC OF KAZAKHSTAN, 2014, (02): : 21 - 24