Multi-Source Style Transfer via Style Disentanglement Network

被引:2
|
作者
Wang, Quan [1 ]
Li, Sheng [2 ]
Wang, Zichi [1 ]
Zhang, Xinpeng [1 ]
Feng, Guorui [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 200438, Peoples R China
关键词
Style transfer; style disentanglement; style swap; content component; style component;
D O I
10.1109/TMM.2023.3281087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Despite the great success of deep neural networks for style transfer tasks, the entanglement of content and style in images leads to more style information not being captured. To tackle this problem, a novel style disentanglement network is proposed to transfer multi-source style elements. Specifically, we specialize in designing a learnable content style separation module, which can efficiently extract content and style components from images in the latent space. This method differs from the previous approaches by predefining content and style layers in the network. Under the condition of content and style separation, we continue to propose the multi-style swap module, which allows the content image to match more style elements. Additionally, by introducing alternate training strategies for the main and auxiliary decoders as well as style disentanglement loss, the stylized results look very similar to the original artworks. Experimental results demonstrate the superiority of our proposed method compared with existing schemes.
引用
收藏
页码:1373 / 1383
页数:11
相关论文
共 50 条
  • [1] Content and Style Disentanglement for Artistic Style Transfer
    Kotovenko, Dmytro
    Sanakoyeu, Artsiom
    Lang, Sabine
    Ommer, Bjorn
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4421 - 4430
  • [2] Style Semantic Disentangle Network for Multi-Source Domain Generalization
    Guo, Song
    Luo, Haiyong
    Zhu, Yida
    Zhao, Fang
    [J]. 2023 IEEE 8TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS, ICBDA, 2023, : 31 - 38
  • [3] Style quantification of scanned multi-source digits
    Zhang, Xiaoli
    Nagy, George
    [J]. 18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2006, : 1018 - +
  • [4] Arbitrary Style Transfer via Multi-Adaptation Network
    Deng, Yingying
    Tang, Fan
    Dong, Weiming
    Sun, Wen
    Huang, Feiyue
    Xu, Changsheng
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2719 - 2727
  • [5] Text Style Transfer based on Multi-factor Disentanglement and Mixture
    Zhu, Anna
    Yin, Zhanhui
    Iwana, Brian Kenji
    Zhou, Xinyu
    Xiong, Shengwu
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 2430 - 2440
  • [6] Image Style Transfer via Multi-Style Geometry Warping
    Alexandru, Ioana
    Nicula, Constantin
    Prodan, Cristian
    Rotaru, Razvan-Paul
    Tarba, Nicolae
    Boiangiu, Costin-Anton
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (12):
  • [7] The segmentation effect of style transfer on fetal head ultrasound image: a study of multi-source data
    Mengqiang Zhou
    Chuan Wang
    Yaosheng Lu
    Ruiyu Qiu
    Rongdan Zeng
    Dengjiang Zhi
    Xiaosong Jiang
    Zhanhong Ou
    Huijin Wang
    Gaowen Chen
    Jieyun Bai
    [J]. Medical & Biological Engineering & Computing, 2023, 61 : 1017 - 1031
  • [8] The segmentation effect of style transfer on fetal head ultrasound image: a study of multi-source data
    Zhou, Mengqiang
    Wang, Chuan
    Lu, Yaosheng
    Qiu, Ruiyu
    Zeng, Rongdan
    Zhi, Dengjiang
    Jiang, Xiaosong
    Ou, Zhanhong
    Wang, Huijin
    Chen, Gaowen
    Bai, Jieyun
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2023, 61 (05) : 1017 - 1031
  • [9] Style Mixer: Semantic-aware Multi-Style Transfer Network
    Huang, Zixuan
    Zhang, Jinghuai
    Liao, Jing
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (07) : 469 - 480
  • [10] Latent Style: multi-style image transfer via latent style coding and skip connection
    Hu, Jingfei
    Wu, Guang
    Wang, Hua
    Zhang, Jicong
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (02) : 359 - 368