EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries Using Gaussian Splatting

被引:0
|
作者
Wang, Kailing [1 ]
Yang, Chen [1 ]
Wang, Yuehao [2 ]
Li, Sikuang [1 ]
Wang, Yan [3 ]
Dou, Qi [2 ]
Yang, Xiaokang [1 ]
Shen, Wei [1 ]
机构
[1] Shanghai Jiao Tong Univ, AI Inst, MoE Key Lab Artificial Intelligence, Shanghai, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Ma Liu Shui, Hong Kong, Peoples R China
[3] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Endoscopic surgeries; SLAM; Real-time rendering; Tissue reconstruction; SLAM;
D O I
10.1007/978-3-031-72089-5_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications in endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates simplified Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments and surveys of surgeons show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://loping151.github.io/endogslam.
引用
收藏
页码:219 / 229
页数:11
相关论文
共 50 条
  • [31] Real-time vision-based tracking and reconstruction
    Gabriele Bleser
    Mario Becker
    Didier Stricker
    Journal of Real-Time Image Processing, 2007, 2 : 161 - 175
  • [32] Active catheter tracking using parallel MRI and real-time image reconstruction
    Bock, Michael
    Mueller, Sven
    Zuehlsdorff, Sven
    Speier, Peter
    Fink, Christian
    Hallscheidt, Peter
    Umathum, Reiner
    Semmler, Wolfhard
    MAGNETIC RESONANCE IN MEDICINE, 2006, 55 (06) : 1454 - 1459
  • [33] Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstruction
    Bonilla, Sierra
    Zhang, Shuai
    Psychogyios, Dimitrios
    Stoyanov, Danail
    Vasconcelos, Francisco
    Bano, Sophia
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 274 - 283
  • [34] StereoScan: Dense 3d Reconstruction in Real-time
    Geiger, Andreas
    Ziegler, Julius
    Stiller, Christoph
    2011 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2011, : 963 - 968
  • [35] Real-time rendering of deformable heterogeneous translucent objects using multiresolution splatting
    Chen, Guojun
    Peers, Pieter
    Zhang, Jiawan
    Tong, Xin
    VISUAL COMPUTER, 2012, 28 (6-8): : 701 - 711
  • [36] Real-time rendering of deformable heterogeneous translucent objects using multiresolution splatting
    Guojun Chen
    Pieter Peers
    Jiawan Zhang
    Xin Tong
    The Visual Computer, 2012, 28 : 701 - 711
  • [37] GGRt: Towards Pose-Free Generalizable 3D Gaussian Splatting in Real-Time
    Li, Hao
    Gao, Yuanyuan
    Wu, Chenming
    Zhang, Dingwen
    Dai, Yalun
    Zhao, Chen
    Feng, Haocheng
    Ding, Errui
    Wang, Jingdong
    Han, Junwei
    COMPUTER VISION - ECCV 2024, PT LXXI, 2025, 15129 : 325 - 341
  • [38] Object-centric Reconstruction and Tracking of Dynamic Unknown Objects Using 3D Gaussian Splatting
    Barad, Kuldeep R.
    Richard, Antoine
    Dentler, Jan
    Olivares-Mendez, Miguel
    Martinez, Carol
    2024 INTERNATIONAL CONFERENCE ON SPACE ROBOTICS, ISPARO, 2024, : 202 - 209
  • [39] Real-Time Tracking of Endoscopic Ultrasound Guided Hydrogel Injection Using Template Matching
    Huang, P.
    Li, D.
    Shin, E.
    Kim, S.
    Su, L.
    Rao, A.
    Rosati, L.
    Wong, J.
    Narang, A.
    Herman, J.
    Ding, K.
    MEDICAL PHYSICS, 2017, 44 (06) : 3017 - 3017
  • [40] DART: dense articulated real-time tracking with consumer depth cameras
    Schmidt, Tanner
    Newcombe, Richard
    Fox, Dieter
    AUTONOMOUS ROBOTS, 2015, 39 (03) : 239 - 258