Stereoscopic image super-resolution with interactive memory learning

被引:13
|
作者
Zhu, Xiangyuan [1 ]
Guo, Kehua [1 ]
Qiu, Tian [1 ]
Fang, Hui [2 ]
Wu, Zheng [1 ]
Tan, Xuyang [1 ]
Liu, Chao [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, South Rd Lushan, Changsha 410083, Hunan, Peoples R China
[2] Loughborough Univ, Comp Sci, Epinal Way, Loughborough LE11 3TU, Leics, England
[3] Acad Mil Sci, Inst Syst Engn, Peoples Liberat Army, Beijing 100000, Peoples R China
基金
美国国家科学基金会;
关键词
Image super-resolution; Stereo image; Interactive learning; Memory network; Feature refinement; PARALLAX ATTENTION; NETWORK;
D O I
10.1016/j.eswa.2023.120143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution aims to exploit the complementary information between image pairs and generate images with high resolution and rich details. However, existing methods explicitly calculate the similarity between image patches or pixels to build correspondence between different views. These hard -matching methods leave deep semantic information between image pairs unexplored. In this paper, a stereo image super-resolution method with interactive memory learning is designed to take advantage of the complementary information of different views in an implicit way. Specifically, we propose an interactive memory learning strategy to implicitly capture the semantic similarity between different views and design a feature dual-aggregation module for feature refinement. Extensive experiments on different datasets achieve state-of-the-art results, demonstrating that our method effectively boosts the quantitative and qualitative results of stereoscopic image pairs. Code can be found at: https://github.com/zhuxiangyuan1/IMLnet.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Simultaneously retargeting and super-resolution for stereoscopic video
    Kang, Kai
    Cao, Yang
    Wang, Zengfu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (08) : 11081 - 11095
  • [22] Learning Parallax Attention for Stereo Image Super-Resolution
    Wang, Longguang
    Wang, Yingqian
    Liang, Zhengfa
    Lin, Zaiping
    Yang, Jungang
    An, Wei
    Guo, Yulan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12242 - 12251
  • [23] Super-Resolution of Medical Image Using Representation Learning
    Yang, Xiong
    Zhan, Shu
    Hu, Changsheng
    Liang, Zhicheng
    Xie, Dongdong
    2016 8TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS & SIGNAL PROCESSING (WCSP), 2016,
  • [24] Single Image Super-resolution Based on Residual Learning
    Xie, Chao
    Lu, Xiaobo
    PROCEEDINGS OF 2017 INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING (ICVIP 2017), 2017, : 124 - 129
  • [25] Deep Learning for Remote Sensing Image Super-Resolution
    Ul Hoque, Md Reshad
    Burks, Roland, III
    Kwan, Chiman
    Li, Jiang
    2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, : 286 - 292
  • [26] Learning Deep Analysis Dictionaries for Image Super-Resolution
    Huang, Jun-Jie
    Dragotti, Pier Luigi
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 6633 - 6648
  • [27] Learning Parametric Sparse Models for Image Super-Resolution
    Li, Yongbo
    Dong, Weisheng
    Xie, Xuemei
    Shi, Guangming
    Li, Xin
    Xu, Donglai
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [28] Image Super-Resolution Method Based on Dual Learning
    Qiu, Zhao
    Zhuang, Chunyu
    Liu, Lihao
    Lin, Jiale
    Yuan, Sheng
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (16)
  • [29] Learning ramp transformation for single image super-resolution
    Singh, Abhishek
    Ahuja, Narendra
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2015, 135 : 109 - 125
  • [30] Deep Learning for Multiple-Image Super-Resolution
    Kawulok, Michal
    Benecki, Pawel
    Piechaczek, Szymon
    Hrynczenko, Krzysztof
    Kostrzewa, Daniel
    Nalepa, Jakub
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (06) : 1062 - 1066