Pose and Skeleton-aware Neural IK for Pose and Motion Editing

被引:0
|
作者
Agrawal, Dhruv [1 ,2 ]
Guay, Martin [2 ]
Buhmann, Jakob [2 ]
Borer, Dominik [2 ]
Sumner, Robert W. [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] DisneyRes Studios, Zurich, Switzerland
关键词
skeletal networks; pose authoring; learned inverse kinematics; 3D animation;
D O I
10.1145/3610548.3618217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Posing a 3D character for film or game is an iterative and laborious process where many control handles (e.g. joints) need to be manipulated to achieve a compelling result. Neural Inverse Kinematics (IK) is a new type of IK that enables sparse control over a 3D character pose, and leverages full body correlations to complete the un-manipulated joints of the body. While neural IK is promising, current methods are not designed to preserve previous edits in posing workflows. Current models generate a single pose from the handles only-regardless of what was there previously-making it difficult to preserve any variations and hindering tasks such as pose and motion editing. In this paper, we introduce SKEL-IK, a novel architecture and training scheme that is conditioned on a base pose, and designed to flow information directly onto the skeletal graph structure, such that hard constraints can be enforced by blocking information flows at certain joints. As a result, we are able to satisfy both hard and soft constraints, as well as preserve un-manipulated parts of the body when desired. Finally, by controlling the base pose in different ways, we demonstrate the ability of our model to perform tasks such as generating variations and quickly editing poses and motions; with less erosion of the base poses compared to the current state-of-the-art.
引用
收藏
页数:10
相关论文
共 50 条
  • [11] Boneless pose editing and animation
    Baerentzen, J. Andreas
    Hansen, Kristian Evers
    Erleben, Kenny
    IMAGE ANALYSIS, PROCEEDINGS, 2007, 4522 : 562 - +
  • [12] Motion-Pose Recurrent Neural Network with Instantaneous Kinematic Descriptor for Skeleton Based Gesture Detection and Recognition
    Zhang, Zhi
    Song, Yonghong
    Zhang, Yuanlin
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 764 - 769
  • [13] Linking Pose and Motion
    Fossati, Andrea
    Fua, Pascal
    COMPUTER VISION - ECCV 2008, PT IV, PROCEEDINGS, 2008, 5305 : 200 - 213
  • [14] Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior
    Zhao, Qingqing
    Li, Peizhuo
    Yifan, Wang
    Olga, Sorkine-Hornung
    Wetzstein, Gordon
    Computer Graphics Forum, 2024, 43 (08)
  • [15] CullNet: Calibrated and Pose Aware Confidence Scores for Object Pose Estimation
    Gupta, Kartik
    Petersson, Lars
    Hartley, Richard
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2758 - 2766
  • [16] Progressive Direction-Aware Pose Grammar for Human Pose Estimation
    Zhou, Lu
    Chen, Yingying
    Wang, Jinqiao
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2023, 5 (04): : 593 - 605
  • [17] Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part
    Hu, Lei
    Zhang, Zihao
    Zhong, Chongyang
    Jiang, Boyuan
    Xia, Shihong
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4792 - 4808
  • [18] Limb Pose Aware Networks for Monocular 3D Pose Estimation
    Wu, Lele
    Yu, Zhenbo
    Liu, Yijiang
    Liu, Qingshan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 906 - 917
  • [19] POSE AWARE FINE-GRAINED VISUAL CLASSIFICATION USING POSE EXPERTS
    Mahajan, Kushagra
    Khurana, Tarasha
    Chopra, Ayush
    Gupta, Isha
    Arora, Chetan
    Rai, Atul
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2381 - 2385
  • [20] Pose and motion from contact
    Jia, YB
    Erdmann, M
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 1999, 18 (05): : 466 - 490