Appearance and Pose-guided Human Generation: A Survey

被引:0
|
作者
Liao, Fangjian [1 ]
Zou, Xingxing [2 ,3 ]
Wong, Waikeung [2 ,3 ]
机构
[1] Hong Kong Polytech Univ, Sch Fash & Text, Kowloon, Hong Kong, Peoples R China
[2] Hong Kong Polytech Univ, Sch Fash & Text, Hong Kong, Peoples R China
[3] Lab Artificial Intelligence Design, Pak Shek Kok New Terr, Hong Kong, Peoples R China
关键词
Conditional human generation; pose transfer; virtual fitting; image editing; generative adversarial networks; diffusion models; IMAGE; ATTENTION; GAN;
D O I
10.1145/3637060
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Appearance and pose-guided human generation is a burgeoning field that has captured significant attention. This subject's primary objective is to transfer pose information from a target source to a reference image, enabling the generation of high-resolution images or videos that seamlessly link the virtual and real worlds, leading to novel trends and applications. This survey thoroughly illustrates the task of appearance and pose-guided human generation and comprehensively reviews mainstream methods. Specifically, it systematically discusses prior information, pose-based transformation modules, and generators, offering a comprehensive understanding and discussion of each mainstream pose transformation and generation process. Furthermore, the survey explores current applications and future challenges in the domain. Its ultimate goal is to serve as quick guidelines, providing practical assistance in human generation and its diverse applications.
引用
收藏
页数:35
相关论文
共 50 条
  • [1] Pose-Guided 3D Human Generation in Indoor Scene
    Kim, Minseok
    Kang, Changwoo
    Park, Jeongin
    Joo, Kyungdon
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1133 - 1141
  • [2] Coordinate-based Texture Inpainting for Pose-Guided Human Image Generation
    Grigorev, Artur
    Sevastopolsky, Artem
    Vakhitov, Alexander
    Lempitsky, Victor
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12127 - 12136
  • [3] Pose-Guided Level Design
    Zhang, Yongqi
    Xie, Biao
    Huang, Haikun
    Ogawa, Elisa
    You, Tongjian
    Yu, Lap-Fai
    [J]. CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
  • [4] POSE2BODY: POSE-GUIDED HUMAN PARTS SEGMENTATION
    Li, Zhong
    Chen, Xin
    Zhou, Wangyiteng
    Zhang, Yingliang
    Yu, Jingyi
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 640 - 645
  • [5] PoNA: Pose-Guided Non-Local Attention for Human Pose Transfer
    Li, Kun
    Zhang, Jinsong
    Liu, Yebin
    Lai, Yu-Kun
    Dai, Qionghai
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 9584 - 9599
  • [6] Pose-Guided Human Parsing by an AND/OR Graph Using Pose-Context Features
    Xia, Fangting
    Zhu, Jun
    Wang, Peng
    Yuille, Alan L.
    [J]. THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 3632 - 3640
  • [7] Pose-Guided Hierarchical Semantic Decomposition and Composition for Human Parsing
    Yang, Beibei
    Yu, Changqian
    Yu, Jin-Gang
    Gao, Changxin
    Sang, Nong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (03) : 1641 - 1652
  • [8] Pose-Guided Human Animation from a Single Image in the Wild
    Yoon, Jae Shin
    Liu, Lingjie
    Golyanik, Vladislav
    Sarkar, Kripasindhu
    Park, Hyun Soo
    Theobalt, Christian
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15034 - 15043
  • [9] Deep Spatial Transformation for Pose-Guided Person Image Generation and Animation
    Ren, Yurui
    Li, Ge
    Liu, Shan
    Li, Thomas H.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8622 - 8635
  • [10] Follow Your Pose: Pose-Guided Text-to-Video Generation Using Pose-Free Videos
    Ma, Yue
    He, Yingqing
    Cun, Xiaodong
    Wang, Xintao
    Chen, Siran
    Li, Xiu
    Chen, Qifeng
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4117 - 4125