Pose and Skeleton-aware Neural IK for Pose and Motion Editing

被引:0
|
作者
Agrawal, Dhruv [1 ,2 ]
Guay, Martin [2 ]
Buhmann, Jakob [2 ]
Borer, Dominik [2 ]
Sumner, Robert W. [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] DisneyRes Studios, Zurich, Switzerland
关键词
skeletal networks; pose authoring; learned inverse kinematics; 3D animation;
D O I
10.1145/3610548.3618217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Posing a 3D character for film or game is an iterative and laborious process where many control handles (e.g. joints) need to be manipulated to achieve a compelling result. Neural Inverse Kinematics (IK) is a new type of IK that enables sparse control over a 3D character pose, and leverages full body correlations to complete the un-manipulated joints of the body. While neural IK is promising, current methods are not designed to preserve previous edits in posing workflows. Current models generate a single pose from the handles only-regardless of what was there previously-making it difficult to preserve any variations and hindering tasks such as pose and motion editing. In this paper, we introduce SKEL-IK, a novel architecture and training scheme that is conditioned on a base pose, and designed to flow information directly onto the skeletal graph structure, such that hard constraints can be enforced by blocking information flows at certain joints. As a result, we are able to satisfy both hard and soft constraints, as well as preserve un-manipulated parts of the body when desired. Finally, by controlling the base pose in different ways, we demonstrate the ability of our model to perform tasks such as generating variations and quickly editing poses and motions; with less erosion of the base poses compared to the current state-of-the-art.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Skeleton-Aware Networks for Deep Motion Retargeting
    Aberman, Kfir
    Li, Peizhuo
    Lischinski, Dani
    Sorkine-Hornung, Olga
    Cohen-Or, Daniel
    Chen, Baoquan
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (04):
  • [2] Skeleton-aware Multi-scale Heatmap Regression for 2D Hand Pose Estimation
    Kourbane, Ikram
    Genc, Yakup
    INFORMATICA-AN INTERNATIONAL JOURNAL OF COMPUTING AND INFORMATICS, 2021, 45 (04): : 593 - 604
  • [3] Skeleton-aware Multi-scale Heatmap Regression for 2D Hand Pose Estimation
    Kourbane, Ikram
    Genc, Yakup
    Informatica (Slovenia), 2021, 45 (04): : 593 - 604
  • [4] Skeleton-Aware Neural Sign Language Translation
    Gan, Shiwei
    Yin, Yafeng
    Jiang, Zhiwei
    Xie, Lei
    Lu, Sanglu
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4353 - 4361
  • [5] ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors
    Zhang, Wanyue
    Dabral, Rishabh
    Leimkuhler, Thomas
    Golyanik, Vladislav
    Habermann, Marc
    Theobalt, Christian
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 1392 - 1402
  • [6] Socially and Contextually Aware Human Motion and Pose Forecasting
    Adeli, Vida
    Adeli, Ehsan
    Reid, Ian
    Niebles, Juan Carlos
    Rezatofighi, Hamid
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) : 6033 - 6040
  • [7] Skeleton-aware size variations in digital mannequins
    Kasap, Mustafa
    Magnenat-Thalmann, Nadia
    VISUAL COMPUTER, 2011, 27 (04): : 263 - 274
  • [8] Skeleton-aware size variations in digital mannequins
    Mustafa Kasap
    Nadia Magnenat-Thalmann
    The Visual Computer, 2011, 27 : 263 - 274
  • [9] Skeleton2Stroke: Interactive Stroke Correspondence Editing with Pose Features
    Miyauchi, Ryoma
    Peng, Yichen
    Fukusato, Tsukasa
    Xie, Haoran
    PROCEEDINGS OF SIGGRAPH ASIA 2021 TECHNICAL COMMUNICATIONS, 2021,
  • [10] Industry robotic motion and pose recognition method based on camera pose estimation and neural network
    Wang, Ding
    Xie, Fei
    Yang, Jiquan
    Lu, Rongjian
    Zhu, Tengfei
    Liu, Yijian
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2021, 18 (03):