Attention-based Fusion for Multi-source Human Image Generation

被引:0
|
作者
Lathuiliere, Stephane [1 ]
Sangineto, Enver [2 ]
Siarohin, Aliaksandr [2 ]
Sebe, Nicu [2 ,3 ]
机构
[1] Inst Polytech Paris, Telecom Paris, LTCI, Paris, France
[2] Univ Trento, DISI, Trento, Italy
[3] Huawei Technol Ireland, Dublin, Ireland
基金
欧洲研究理事会;
关键词
D O I
10.1109/wacv45572.2020.9093602
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images. In this way, we can exploit multiple, possibly complementary images of the same person which are usually available at training and at testing time. The solution we propose is mainly based on a local attention mechanism which selects relevant information from different source image regions, avoiding the necessity to build specific generators for each specific cardinality of X. The empirical evaluation of our method shows the practical interest of addressing the person-image generation problem in a multi-source setting.
引用
收藏
页码:428 / 437
页数:10
相关论文
共 50 条
  • [1] Multi-Source Attention-Based Fusion for Segmentation of Natural Disasters
    El Rai, Marwa Chendeb
    Darweesh, Muna
    Far, Aicha Beya
    Gawanmeh, Amjad
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [2] Attention-Based Multi-Source Domain Adaptation
    Zuo, Yukun
    Yao, Hantao
    Xu, Changsheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3793 - 3803
  • [3] A survey of multi-source image fusion
    Li, Rui
    Zhou, Mingquan
    Zhang, Dan
    Yan, Yuhuan
    Huo, Qingsong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 18573 - 18605
  • [4] A survey of multi-source image fusion
    Rui Li
    Mingquan Zhou
    Dan Zhang
    Yuhuan Yan
    Qingsong Huo
    Multimedia Tools and Applications, 2024, 83 : 18573 - 18605
  • [5] Variational multi-source image fusion based on the structure tensor
    Zhao Wen-Da
    Zhao Jian
    Xu Zhi-Jun
    ACTA PHYSICA SINICA, 2013, 62 (21)
  • [6] MsIFT: Multi-Source Image Fusion Transformer
    Zhang, Xin
    Jiang, Hangzhi
    Xu, Nuo
    Ni, Lei
    Huo, Chunlei
    Pan, Chunhong
    REMOTE SENSING, 2022, 14 (16)
  • [7] Variational approach for multi-source image fusion
    Tang, Sizhang
    Fang, Faming
    Zhang, Guixu
    IET IMAGE PROCESSING, 2015, 9 (02) : 134 - 141
  • [8] Multi focus and multi-source image fusion based on deep learning model
    Fu, Jie
    Gao, Xin-Ran
    Xu, Min
    Wang, Wenju
    2019 2ND WORLD CONFERENCE ON MECHANICAL ENGINEERING AND INTELLIGENT MANUFACTURING (WCMEIM 2019), 2019, : 512 - 515
  • [9] Hierarchical Attention-Based Fusion for Image Caption With Multi-Grained Rewards
    Wu, Chunlei
    Yuan, Shaozu
    Cao, Haiwen
    Wei, Yiwei
    Wang, Leiquan
    IEEE ACCESS, 2020, 8 (08): : 57943 - 57951
  • [10] MULTI-SOURCE IMAGE FUSION FOR GNSS-BASED PASSIVE RADAR
    Zhou, Xinkai
    Wang, Pengbo
    Chen, Jie
    Zeng, Hongcheng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3708 - 3711