Real-time correction of nonuniform rotational distortion in endoscopic OCT

被引:0
|
作者
Zhang, Haoran [1 ]
Yang, Jianlong [1 ]
Zhang, Jingqian [1 ]
Zhao, Shiqing [1 ]
Zhang, Aili [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Endoscopic OCT; nonuniform rotational distortion; real-time correction; deep learning;
D O I
10.1117/12.3000714
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Endoscopic optical coherence tomography (OCT) is progressively used in endoluminal imaging because of its high scanning speed and near- cellular spatial resolution. Scanning of the endoscopic probe is implemented mechanically to achieve circumferential rotation and axial pullback. However, this scanning suffers from nonuniform rotational distortion (NURD) due to mechanical friction between the rotating probe and protecting sheath, irregular motor rotation, and so on. Correction of NURD is a prerequisite for endoscopic OCT imaging and its functional extensions, such as angiography and elastography. Previous work requires time-consuming feature tracking or cross-correlation calculations and thus sacrifices temporal resolution. In this work, we propose a cross-attention learning method for accelerating the NURD correction in endoscopic OCT. Our method is inspired by the recent success of the self-attention mechanism in natural language processing and computer vision. By leveraging its ability to model long-range dependencies, we can directly obtain the correlation between OCT A-lines at any distance, thus accelerating the NURD correction. We develop an end-to-end stacked cross-attention network and design three types of optimization constraints. We compare our method with two traditional feature-based methods and a CNN-based method, on two publicly-available endoscopic OCT datasets and a private dataset collected on our home-built endoscopic OCT system. Our method achieved a similar to 3 times speedup to real-time (26 +/- 3 fps), and superior correction performance.
引用
收藏
页数:3
相关论文
共 50 条
  • [1] Cross-attention learning enables real-time nonuniform rotational distortion correction in OCT
    Zhang, Haoran
    Yang, Jianlong
    Zhang, Jingqian
    Zhao, Shiqing
    Zhang, Aili
    [J]. BIOMEDICAL OPTICS EXPRESS, 2024, 15 (01) : 319 - 335
  • [2] Time Multiplexed VLSI Architecture for Real-Time Barrel Distortion Correction in Video-Endoscopic Images
    Chen, Shih-Lun
    Huang, Hong-Yi
    Luo, Ching-Hsing
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2011, 21 (11) : 1612 - 1621
  • [3] Improved FAST algorithm for non-uniform rotational distortion correction in OCT endoscopic imaging
    Cao, Guogang
    Li, Sicheng
    Zhang, Shu
    Peng, Zeyu
    Wu, Yan
    Wang, Dong
    Dai, Cuixia
    [J]. OPTICS EXPRESS, 2023, 31 (02) : 2754 - 2767
  • [4] Evaluation and correction of distortion for real-time terahertz camera
    Perraud, J-B
    Redon, O.
    Lalanne-Dera, J.
    Guillet, J-P
    Simoens, F.
    Meilhan, J.
    Mounaix, P.
    [J]. 2017 42ND INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER, AND TERAHERTZ WAVES (IRMMW-THZ), 2017,
  • [5] Efficient Real-Time Radial Distortion Correction for UAVs
    Ornhag, Marcus Valtonen
    Persson, Patrik
    Wadenback, Marten
    Astrom, Kalle
    Heyden, Anders
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 1750 - 1759
  • [6] Distortion-free freehand-scanning OCT implemented with real-time scanning speed variance correction
    Liu, Xuan
    Huang, Yong
    Kang, Jin U.
    [J]. OPTICS EXPRESS, 2012, 20 (15): : 16567 - 16583
  • [7] Real-time lens distortion correction using texture mapping
    Bax, MR
    [J]. MEDICAL IMAGING 2003: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND DISPLAY, 2003, 5029 : 249 - 256
  • [8] Real-time digital image warping for display distortion correction
    Han, DI
    [J]. IMAGE ANALYSIS AND RECOGNITION, 2005, 3656 : 1258 - 1265
  • [9] Real-time correction method for image distortion on smart phone
    Chen Lei
    Tian Hengda
    Ji Xiaoyong
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL FORUM ON MANAGEMENT, EDUCATION AND INFORMATION TECHNOLOGY APPLICATION (IFMEITA 2017), 2017, 130 : 345 - 350
  • [10] Real-time lens distortion correction: speed, accuracy and efficiency
    Bax, Michael R.
    Shahidi, Ramin
    [J]. OPTICAL ENGINEERING, 2014, 53 (11)