Multiangle feature fusion network for style transfer

被引:0
|
作者
Hu, Zhenshan [1 ]
Ge, Bin [1 ]
Xia, Chenxing [1 ]
机构
[1] Anhui Univ Sci & Technol, Coll Comp Sci & Engn, Huainan 232001, Peoples R China
基金
中国国家自然科学基金;
关键词
Style transfer; Image generation; Feature fusion; Attention mechanism; Style-conditioned;
D O I
10.1016/j.imavis.2024.105386
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, arbitrary style transfer has gained a lot of attention from researchers. Although existing methods achieve good results, the generated images are usually biased towards styles, resulting in images with artifacts and repetitive patterns. To address the above problems, we propose a multi-angle feature fusion network for style transfer (MAFST). MAFST consists of a Multi-Angle Feature Fusion module (MAFF), a Multi-Scale Style Capture module (MSSC), multi-angle loss, and a content temporal consistency loss. MAFF can process the captured features from channel level and pixel level, and feature fusion is performed both locally and globally. MSSC processes the shallow style features and optimize generated images. To guide the model to focus on local features, we introduce a multi-angle loss. The content temporal consistency loss extends image style transfer to video style transfer. Extensive experiments have demonstrated that our proposed MAFST can effectively avoid images with artifacts and repetitive patterns. MAFST achieves advanced performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Puff-Net: Efficient Style Transfer with Pure Content and Style Feature Fusion Network
    Zheng, Sizhe
    Gao, Pan
    Zhou, Peng
    Qin, Jie
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 8059 - 8068
  • [2] Content Feature and Style Feature Fusion Network for Single Image Dehazing
    Yang A.-P.
    Liu J.
    Xing J.-N.
    Li X.-X.
    He Y.-Q.
    Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (04): : 769 - 777
  • [3] MAPFF: Multiangle Pyramid Feature Fusion Network for Infrared Dim Small Target Detection
    Yang, Hai
    Liu, Jing
    Wang, Zhe
    Fu, Zhiling
    Tan, Qinyan
    Niu, Saisai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [4] Image style transfer with saliency constrained and SIFT feature fusion
    Sun, Yaqi
    Xie, Xiaolan
    Li, Zhi
    Zhao, Huihuang
    VISUAL COMPUTER, 2024, : 4915 - 4930
  • [5] EFANet: Exchangeable Feature Alignment Network for Arbitrary Style Transfer
    Wu, Zhijie
    Song, Chunjin
    Zhou, Yang
    Gong, Minglun
    Huang, Hui
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12305 - 12312
  • [6] Research and design of image style transfer technology based on multi-scale convolutional neural network feature fusion
    Liang, Yongzhen
    Lin, Feng
    Xie, Wensheng
    Wang, Jinzhong
    Nie, Tian
    ELECTRONICS LETTERS, 2024, 60 (11)
  • [7] Mural Style Transfer with Feature Clustering and Deep Residual Shrinkage Network
    Meng, Wu
    Gao, Yining
    Jia, Wang
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (16)
  • [8] MAFNet: A Multiangle Attention Fusion Network for Land Cover Classification
    Miao, Guoying
    Wang, Huiqin
    Zhang, Enwei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 8655 - 8670
  • [9] Unsupervised Bidirectional Style Transfer Network using Local Feature Transform Module
    Bae, Kangmin
    Kim, Hyung-Il
    Kwon, Yongjin
    Moon, Jinyoung
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2023, : 740 - 749
  • [10] Decoder Network over Lightweight Reconstructed Feature for Fast Semantic Style Transfer
    Lu, Ming
    Zhao, Hao
    Yao, Anbang
    Xu, Feng
    Chen, Yurong
    Zhang, Li
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2488 - 2496