FSFN: feature separation and fusion network for single image super-resolution

被引:1
|
作者
Zhu, Kai [1 ]
Chen, Zhenxue [1 ,2 ]
Wu, Q. M. Jonathan [3 ]
Wang, Nannan [2 ]
Zhao, Jie [1 ,4 ]
Zhang, Gan [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[4] Shandong Univ, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Super-resolution; Feature separation; Feature fusion; Residual learning; Deep learning; CNN;
D O I
10.1007/s11042-021-11121-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, image super-resolution (SR) based on deep learning technology has made significant progress. However, most methods are difficult to apply in real life because of their large parameters and heavy computation. Recently, residual learning has been widely applied to the problem of super-resolution. It can make the shallow features extracted from the input image act on each middle layer through long and short connection. Therefore, residual learning can be focused on processing high-frequency feature information, which significantly improves the SR performance of the network. However, with the improvement of network depth, the features that can be effectively utilized are still the shallow ones extracted from the input image. In this paper, we propose the feature separation and fusion network(FSFN). We further enrich the high-frequency feature information by separating and fusing the extracted and unextracted features in the internal shallow layer of each feature separation and fusion module. As the depth of the network increases, the shallow features extracted from the input image can be updated in a direction closer to those extracted from the real high-resolution image. A large number of experimental results show that this method has a strong performance compared with the existing SR algorithm with similar parameters and computation.
引用
收藏
页码:31599 / 31618
页数:20
相关论文
共 50 条
  • [1] FSFN: feature separation and fusion network for single image super-resolution
    Kai Zhu
    Zhenxue Chen
    Q. M. Jonathan Wu
    Nannan Wang
    Jie Zhao
    Gan Zhang
    [J]. Multimedia Tools and Applications, 2021, 80 : 31599 - 31618
  • [2] Lightweight Feature Fusion Network for Single Image Super-Resolution
    Yang, Wenming
    Wang, Wei
    Zhang, Xuechen
    Sun, Shuifa
    Liao, Qingmin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (04) : 538 - 542
  • [3] Feature Fusion Attention Network for Image Super-resolution
    Zhou, Deng-Wen
    Ma, Lu-Yao
    Tian, Jin-Yue
    Sun, Xiu-Xiu
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2233 - 2241
  • [4] Multi-level Feature Fusion Network for Single Image Super-Resolution
    Zhang, Xinxia
    Zhang, Xiaoqin
    Zhao, Li
    Jiang, Runhua
    Huang, Pengcheng
    Xu, Jiawei
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3361 - 3368
  • [5] A Lightweight Pyramid Feature Fusion Network for Single Image Super-Resolution Reconstruction
    Liu, Bingzan
    Ning, Xin
    Ma, Shichao
    Lian, Xiaobin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1575 - 1579
  • [6] Multi-feature fusion attention network for single image super-resolution
    Chen, Jiacheng
    Wang, Wanliang
    Xing, Fangsen
    Tu, Hangyao
    [J]. IET IMAGE PROCESSING, 2023, 17 (05) : 1389 - 1402
  • [7] Disentangled feature fusion network for lightweight image super-resolution
    Liu, Huilin
    Zhou, Jianyu
    Su, Shuzhi
    Yang, Gaoming
    Zhang, Pengfei
    [J]. DIGITAL SIGNAL PROCESSING, 2024, 154
  • [8] Image Super-Resolution Network Based on Feature Fusion Attention
    Zou, Changjun
    Ye, Lintao
    [J]. JOURNAL OF SENSORS, 2022, 2022
  • [9] Single Image Super-Resolution Based on Global Dense Feature Fusion Convolutional Network
    Xu, Wang
    Chen, Renwen
    Huang, Bin
    Zhang, Xiang
    Liu, Chuan
    [J]. SENSORS, 2019, 19 (02)
  • [10] Lightweight hierarchical residual feature fusion network for single-image super-resolution
    Qin, Jiayi
    Liu, Feiqiang
    Liu, Kai
    Jeon, Gwanggil
    Yang, Xiaomin
    [J]. NEUROCOMPUTING, 2022, 478 : 104 - 123