Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:2
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [1] Sophon: Super-Resolution Enhanced 360° Video Streaming with Visual Saliency-aware Prefetch
    Shi, Jianxin
    Pu, Lingjun
    Yuan, Xinjing
    Gong, Qianyun
    Xu, Jingdong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3124 - 3133
  • [2] Enhanced Deep Image Super-Resolution
    Singh, Shrey
    Afreen, Nishat
    Kumar, Sanjay
    2018 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2018, : 1207 - 1211
  • [3] Deep learning for image super-resolution
    Yang, Wenming
    Zhou, Fei
    Zhu, Rui
    Fukui, Kazuhiro
    Wang, Guijin
    Xue, Jing-Hao
    NEUROCOMPUTING, 2020, 398 (398) : 291 - 292
  • [4] Endoscopic Image Deblurring and Super-Resolution Reconstruction Based on Deep Learning
    Yang, Xirui
    Chen, Yue
    Tao, Rui
    Zhang, Yue
    Liu, Zhiwen
    Shi, Yonggang
    2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 168 - 172
  • [5] Deep Learning Based Approach Implemented to Image Super-Resolution
    Thuong Le-Tien
    Tuan Nguyen-Thanh
    Hanh-Phan Xuan
    Giang Nguyen-Truong
    Vinh Ta-Quoc
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2020, 11 (04) : 209 - 216
  • [6] Saliency-Aware Image Completion
    Li, Zhengzhi
    Wang, Haoqian
    Li, Kai
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE), 2014, : 509 - 512
  • [7] Lightweight Stepless Super-Resolution of Remote Sensing Images via Saliency-Aware Dynamic Routing Strategy
    Wu, Hanlin
    Ni, Ning
    Zhang, Libao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [8] Advanced deep learning for image super-resolution
    Shamsolmoali, Pourya
    Sadka, Abdul Hamid
    Zhou, Huiyu
    Yang, Wankou
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 82
  • [9] Deep Learning for Image Super-Resolution: A Survey
    Wang, Zhihao
    Chen, Jian
    Hoi, Steven C. H.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3365 - 3387
  • [10] Saliency-aware Image Quality Assessment
    Liu, Zhanghui
    Huang, Yize
    Niu, Yuzhen
    Lin, Lening
    PROCEEDINGS OF THE 2016 2ND WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS, 2016, 81 : 1354 - 1360