Stereoscopic image super-resolution with interactive memory learning

被引:13
|
作者
Zhu, Xiangyuan [1 ]
Guo, Kehua [1 ]
Qiu, Tian [1 ]
Fang, Hui [2 ]
Wu, Zheng [1 ]
Tan, Xuyang [1 ]
Liu, Chao [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, South Rd Lushan, Changsha 410083, Hunan, Peoples R China
[2] Loughborough Univ, Comp Sci, Epinal Way, Loughborough LE11 3TU, Leics, England
[3] Acad Mil Sci, Inst Syst Engn, Peoples Liberat Army, Beijing 100000, Peoples R China
基金
美国国家科学基金会;
关键词
Image super-resolution; Stereo image; Interactive learning; Memory network; Feature refinement; PARALLAX ATTENTION; NETWORK;
D O I
10.1016/j.eswa.2023.120143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution aims to exploit the complementary information between image pairs and generate images with high resolution and rich details. However, existing methods explicitly calculate the similarity between image patches or pixels to build correspondence between different views. These hard -matching methods leave deep semantic information between image pairs unexplored. In this paper, a stereo image super-resolution method with interactive memory learning is designed to take advantage of the complementary information of different views in an implicit way. Specifically, we propose an interactive memory learning strategy to implicitly capture the semantic similarity between different views and design a feature dual-aggregation module for feature refinement. Extensive experiments on different datasets achieve state-of-the-art results, demonstrating that our method effectively boosts the quantitative and qualitative results of stereoscopic image pairs. Code can be found at: https://github.com/zhuxiangyuan1/IMLnet.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] CVIformer: Cross-View Interactive Transformer for Efficient Stereoscopic Image Super-Resolution
    Zhang, Dongyang
    Liang, Shuang
    He, Tao
    Shao, Jie
    Qin, Ke
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [2] Recurrent Interaction Network for Stereoscopic Image Super-Resolution
    Zhang, Zhe
    Peng, Bo
    Lei, Jianjun
    Shen, Haifeng
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2048 - 2060
  • [3] Stereoscopic Image Super-Resolution with Stereo Consistent Feature
    Song, Wonil
    Choi, Sungil
    Jeong, Somi
    Sohn, Kwanghoon
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12031 - 12038
  • [4] Deep Stereoscopic Image Super-Resolution via Interaction Module
    Lei, Jianjun
    Zhang, Zhe
    Fan, Xiaoting
    Yang, Bolan
    Li, Xinxin
    Chen, Ying
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) : 3051 - 3061
  • [5] Dictionary Learning for Image Super-resolution
    Li Juan
    Wu Jin
    Yang Shen
    Liu Jin
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 7195 - 7199
  • [6] Deep learning for image super-resolution
    Yang, Wenming
    Zhou, Fei
    Zhu, Rui
    Fukui, Kazuhiro
    Wang, Guijin
    Xue, Jing-Hao
    NEUROCOMPUTING, 2020, 398 (398) : 291 - 292
  • [7] Image Super-Resolution Using Memory Mechanism
    Liu, Ziyang
    Chen, Weihai
    Wu, Xingming
    Yue, Haosong
    Li, Zhengguo
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 380 - 385
  • [8] Progressive Residual Learning With Memory Upgrade for Ultrasound Image Blind Super-Resolution
    Liu, Heng
    Liu, Jianyong
    Chen, Feng
    Shan, Caifeng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (09) : 4390 - 4401
  • [9] Self-supervised memory learning for scene text image super-resolution
    Guo, Kehua
    Zhu, Xiangyuan
    Schaefer, Gerald
    Ding, Rui
    Fang, Hui
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 258
  • [10] IMAGE SUPER-RESOLUTION BY EXTREME LEARNING MACHINE
    An, Le
    Bhanu, Bir
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 2209 - 2212