Disentangled feature fusion network for lightweight image super-resolution

被引:1
|
作者
Liu, Huilin [1 ]
Zhou, Jianyu [1 ]
Su, Shuzhi [1 ]
Yang, Gaoming [1 ]
Zhang, Pengfei [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Disentanglement; Network width; Feature fusion; Lightweight;
D O I
10.1016/j.dsp.2024.104697
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, the quality of generated images in image super-resolution (SR) has significantly improved due to the widespread application of convolutional neural networks. Existing super-resolution methods often overlook the importance of network width and instead prioritize designing deeper network structures to improve performance. Deeper networks, however, demand greater computational resources and are more challenging to train, making them less suitable for devices with limited performance. To address this issue, we propose a novel method called the disentangled feature fusion network (DFFN). Specifically, we construct dual feature extraction streams (DFES) using the strategies of feature disentanglement and parameter sharing, which increase the network's width without increasing the number of parameters. To facilitate the interaction of information between the dual feature extraction streams, we design a feature interaction module (FIM) that separately enhances high and low- frequency features. Furthermore, a feature fusion module (FFM) is presented to efficiently fuse different levels of high and low-frequency feature information. The proposed DFFN integrates DFES, FIM, and FFM, which not only widens the network without increasing parameters but also minimizes the loss of crucial feature information. Extensive experiments on five benchmark datasets demonstrate that our method significantly outperforms other state-of-the-art lightweight super-resolution methods, achieving a superior balance between parameter quantity, reconstruction performance, and model complexity. The code is available at https://github.com/zhoujyaust/DFFN.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Lightweight Feature Fusion Network for Single Image Super-Resolution
    Yang, Wenming
    Wang, Wei
    Zhang, Xuechen
    Sun, Shuifa
    Liao, Qingmin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (04) : 538 - 542
  • [2] PFFN: Progressive Feature Fusion Network for Lightweight Image Super-Resolution
    Zhang, Dongyang
    Li, Changyu
    Xie, Ning
    Wang, Guoqing
    Shao, Jie
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3682 - 3690
  • [3] A Lightweight Pyramid Feature Fusion Network for Single Image Super-Resolution Reconstruction
    Liu, Bingzan
    Ning, Xin
    Ma, Shichao
    Lian, Xiaobin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1575 - 1579
  • [4] An efficient and lightweight image super-resolution with feature network
    Zang, Yongsheng
    Zhou, Dongming
    Wang, Changcheng
    Nie, Rencan
    Guo, Yanbu
    [J]. OPTIK, 2022, 255
  • [5] Lightweight Multiresolution Feature Fusion Network for Spectral Super-Resolution
    Mei, Shaohui
    Zhang, Ge
    Wang, Nan
    Wu, Bo
    Ma, Mingyang
    Zhang, Yifan
    Feng, Yan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] OSFFNet: Omni-Stage Feature Fusion Network for Lightweight Image Super-Resolution
    Wang, Yang
    Zhang, Tao
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 5660 - 5668
  • [7] Lightweight hierarchical residual feature fusion network for single-image super-resolution
    Qin, Jiayi
    Liu, Feiqiang
    Liu, Kai
    Jeon, Gwanggil
    Yang, Xiaomin
    [J]. NEUROCOMPUTING, 2022, 478 : 104 - 123
  • [8] Residual Feature Attentional Fusion Network for Lightweight Chest CT Image Super-Resolution
    Yang, Kun
    Zhao, Lei
    Wang, Xianghui
    Zhang, Mingyang
    Xue, Linyan
    Liu, Shuang
    Liu, Kun
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 5159 - 5176
  • [9] Multi-Residual Feature Fusion Network for lightweight Single Image Super-Resolution
    Qin, Jiayi
    He, Zheng
    Yan, Binyu
    Jeon, Gwanggil
    Yang, Xiaomin
    [J]. 2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1511 - 1518
  • [10] Feature Fusion Attention Network for Image Super-resolution
    Zhou, Deng-Wen
    Ma, Lu-Yao
    Tian, Jin-Yue
    Sun, Xiu-Xiu
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2233 - 2241