FSFN: feature separation and fusion network for single image super-resolution

被引:1
|
作者
Zhu, Kai [1 ]
Chen, Zhenxue [1 ,2 ]
Wu, Q. M. Jonathan [3 ]
Wang, Nannan [2 ]
Zhao, Jie [1 ,4 ]
Zhang, Gan [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[4] Shandong Univ, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Super-resolution; Feature separation; Feature fusion; Residual learning; Deep learning; CNN;
D O I
10.1007/s11042-021-11121-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, image super-resolution (SR) based on deep learning technology has made significant progress. However, most methods are difficult to apply in real life because of their large parameters and heavy computation. Recently, residual learning has been widely applied to the problem of super-resolution. It can make the shallow features extracted from the input image act on each middle layer through long and short connection. Therefore, residual learning can be focused on processing high-frequency feature information, which significantly improves the SR performance of the network. However, with the improvement of network depth, the features that can be effectively utilized are still the shallow ones extracted from the input image. In this paper, we propose the feature separation and fusion network(FSFN). We further enrich the high-frequency feature information by separating and fusing the extracted and unextracted features in the internal shallow layer of each feature separation and fusion module. As the depth of the network increases, the shallow features extracted from the input image can be updated in a direction closer to those extracted from the real high-resolution image. A large number of experimental results show that this method has a strong performance compared with the existing SR algorithm with similar parameters and computation.
引用
收藏
页码:31599 / 31618
页数:20
相关论文
共 50 条
  • [41] Local-Global Feature Fusion Network for Efficient Hyperspectral Image Super-Resolution
    Xu, Jingran
    Zhao, Jiankang
    Cui, Chao
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [42] A novel lightweight multi-dimension feature fusion network for single-image super-resolution reconstruction
    Xiaoxin Guo
    Zhenchuan Tu
    Guangyu Li
    Zhengran Shen
    Weijia Wu
    [J]. The Visual Computer, 2024, 40 : 1685 - 1696
  • [43] A novel lightweight multi-dimension feature fusion network for single-image super-resolution reconstruction
    Guo, Xiaoxin
    Tu, Zhenchuan
    Li, Guangyu
    Shen, Zhengran
    Wu, Weijia
    [J]. VISUAL COMPUTER, 2024, 40 (03): : 1685 - 1696
  • [44] Residual Feature Attentional Fusion Network for Lightweight Chest CT Image Super-Resolution
    Yang, Kun
    Zhao, Lei
    Wang, Xianghui
    Zhang, Mingyang
    Xue, Linyan
    Liu, Shuang
    Liu, Kun
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 5159 - 5176
  • [45] A deep recursive multi-scale feature fusion network for image super-resolution?
    Liu, Feiqiang
    Yang, Xiaomin
    De Baets, Bernard
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [46] Second-order progressive feature fusion network for image super-resolution reconstruction
    Yu, Lei
    Deng, Qiuyue
    Zheng, Liying
    Wu, Haoyu
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2024, 46 (02): : 391 - 400
  • [47] Depth Image Super-Resolution Reconstruction Network Based on Dual Feature Fusion Guidance
    Geng Haowen
    Wang Yu
    Xin Yanling
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (08)
  • [48] Image Fusion and Super-Resolution with Convolutional Neural Network
    Zhong, Jinying
    Yang, Bin
    Li, Yuehua
    Zhong, Fei
    Chen, Zhongze
    [J]. PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 78 - 88
  • [49] Fusion diversion network for fast, accurate and lightweight single image super-resolution
    Zheng Gu
    Liping Chen
    Yanhong Zheng
    Tong Wang
    Tieying Li
    [J]. Signal, Image and Video Processing, 2021, 15 : 1351 - 1359
  • [50] LOW COMPLEXITY SINGLE IMAGE SUPER-RESOLUTION WITH CHANNEL SPLITTING AND FUSION NETWORK
    Zou, Minqiang
    Tang, Jie
    Wu, Gangshan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2398 - 2402