Stereoscopic image super-resolution with interactive memory learning

被引:13
|
作者
Zhu, Xiangyuan [1 ]
Guo, Kehua [1 ]
Qiu, Tian [1 ]
Fang, Hui [2 ]
Wu, Zheng [1 ]
Tan, Xuyang [1 ]
Liu, Chao [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, South Rd Lushan, Changsha 410083, Hunan, Peoples R China
[2] Loughborough Univ, Comp Sci, Epinal Way, Loughborough LE11 3TU, Leics, England
[3] Acad Mil Sci, Inst Syst Engn, Peoples Liberat Army, Beijing 100000, Peoples R China
基金
美国国家科学基金会;
关键词
Image super-resolution; Stereo image; Interactive learning; Memory network; Feature refinement; PARALLAX ATTENTION; NETWORK;
D O I
10.1016/j.eswa.2023.120143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution aims to exploit the complementary information between image pairs and generate images with high resolution and rich details. However, existing methods explicitly calculate the similarity between image patches or pixels to build correspondence between different views. These hard -matching methods leave deep semantic information between image pairs unexplored. In this paper, a stereo image super-resolution method with interactive memory learning is designed to take advantage of the complementary information of different views in an implicit way. Specifically, we propose an interactive memory learning strategy to implicitly capture the semantic similarity between different views and design a feature dual-aggregation module for feature refinement. Extensive experiments on different datasets achieve state-of-the-art results, demonstrating that our method effectively boosts the quantitative and qualitative results of stereoscopic image pairs. Code can be found at: https://github.com/zhuxiangyuan1/IMLnet.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Single Image Super-Resolution With Multiscale Similarity Learning
    Zhang, Kaibing
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (10) : 1648 - 1659
  • [42] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [43] Learning Texture Transformer Network for Image Super-Resolution
    Yang, Fuzhi
    Yang, Huan
    Fu, Jianlong
    Lu, Hongtao
    Guo, Baining
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5790 - 5799
  • [44] Progressive Attentional Learning for Underwater Image Super-Resolution
    Chen, Xuelei
    Wei, Shiqing
    Yi, Chao
    Quan, Lingwei
    Lu, Cunyue
    INTELLIGENT ROBOTICS AND APPLICATIONS, 2020, 12595 : 233 - 243
  • [45] Image Super-Resolution With Parametric Sparse Model Learning
    Li, Yongbo
    Dong, Weisheng
    Xie, Xuemei
    Shi, Guangming
    Wu, Jinjian
    Li, Xin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (09) : 4638 - 4650
  • [46] A Unified Learning Framework for Single Image Super-Resolution
    Yu, Jifei
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    Zhang, Kaibing
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (04) : 780 - 792
  • [47] Local Learning-Based Image Super-Resolution
    Lu, Xiaoqiang
    Yuan, Haoliang
    Yuan, Yuan
    Yan, Pingkun
    Li, Luoqing
    Li, Xuelong
    2011 IEEE 13TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2011,
  • [48] Transfer Learning Based on A plus for Image Super-Resolution
    Su, Mei
    Zhong, Sheng-hua
    Jiang, Jian-min
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2016, 2016, 9983 : 325 - 336
  • [49] Coupled Adversarial Learning for Single Image Super-Resolution
    Hsu, Chih-Chung
    Huang, Kuan-Yu
    2020 IEEE 11TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2020,
  • [50] Deep Bilateral Learning for Stereo Image Super-Resolution
    Xu, Qingyu
    Wang, Longguang
    Wang, Yingqian
    Sheng, Weidong
    Deng, Xinpu
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 613 - 617