Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:2
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [41] DEEP LEARNING BASED IMAGE SUPER-RESOLUTION WITH COUPLED BACKPROPAGATION
    Guo, Tiantong
    Mousavi, Hojjai S.
    Monga, Vishal
    2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 237 - 241
  • [42] A Review of Hyperspectral Image Super-Resolution Based on Deep Learning
    Chen, Chi
    Wang, Yongcheng
    Zhang, Ning
    Zhang, Yuxi
    Zhao, Zhikang
    REMOTE SENSING, 2023, 15 (11)
  • [43] Learning Deep Resonant Prior for Hyperspectral Image Super-Resolution
    Gong, Zhaori
    Wang, Nannan
    Cheng, De
    Jiang, Xinrui
    Xin, Jingwei
    Yang, Xi
    Gao, Xinbo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [44] A Review of Single Image Super-resolution Based on Deep Learning
    Zhang N.
    Wang Y.-C.
    Zhang X.
    Xu D.-D.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (12): : 2479 - 2499
  • [45] Deep Learning for Simultaneous Seismic Image Super-Resolution and Denoising
    Li, Jintao
    Wu, Xinming
    Hu, Zhanxuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [46] Enhanced local distribution learning for real image super-resolution
    Sun, Yaoqi
    Chen, Quan
    Xu, Wen
    Huang, Aiai
    Yan, Chenggang
    Zheng, Bolun
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 247
  • [47] Image Super-Resolution with Deep Dictionary
    Maeda, Shunta
    COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 464 - 480
  • [48] Saliency-aware image-to-class distances for image classification
    Peng, Peng
    Shao, Ling
    Han, Jungong
    Han, Junwei
    NEUROCOMPUTING, 2015, 166 : 337 - 345
  • [49] Contour enhanced image super-resolution
    Kong, Linhua
    Wang, Yiming
    Chang, Dongxia
    Zhao, Yao
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 89
  • [50] Learning Temporal Dynamics for Video Super-Resolution: A Deep Learning Approach
    Liu, Ding
    Wang, Zhaowen
    Fan, Yuchen
    Liu, Xianming
    Wang, Zhangyang
    Chang, Shiyu
    Wang, Xinchao
    Huang, Thomas S.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (07) : 3432 - 3445