EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries Using Gaussian Splatting

被引:0
|
作者
Wang, Kailing [1 ]
Yang, Chen [1 ]
Wang, Yuehao [2 ]
Li, Sikuang [1 ]
Wang, Yan [3 ]
Dou, Qi [2 ]
Yang, Xiaokang [1 ]
Shen, Wei [1 ]
机构
[1] Shanghai Jiao Tong Univ, AI Inst, MoE Key Lab Artificial Intelligence, Shanghai, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Ma Liu Shui, Hong Kong, Peoples R China
[3] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Endoscopic surgeries; SLAM; Real-time rendering; Tissue reconstruction; SLAM;
D O I
10.1007/978-3-031-72089-5_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications in endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates simplified Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments and surveys of surgeons show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://loping151.github.io/endogslam.
引用
收藏
页码:219 / 229
页数:11
相关论文
共 50 条
  • [1] RD-SLAM: Real-Time Dense SLAM Using Gaussian Splatting
    Guo, Chaoyang
    Gao, Chunyan
    Bai, Yiyang
    Lv, Xiaoling
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [2] EndoSparse: Real-Time Sparse View Synthesis of Endoscopic Scenes using Gaussian Splatting
    Li, Chenxin
    Feng, Brandon Y.
    Liu, Yifan
    Liu, Hengyu
    Wang, Cheng
    Yu, Weihao
    Yuan, Yixuan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 252 - 262
  • [3] Real-time Gaussian Splatting for Dynamic Reconstruction in Stationary Monocular Cameras
    Chen, Minyu
    Xie, Weixing
    Deng, Zhiyang
    Shi, Chenglong
    Gou, Ruoxuan
    Chen, Yingxuan
    Dong, Xiao
    2024 IEEE 4TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE, SEAI 2024, 2024, : 33 - 37
  • [4] RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting
    Peng, Zhexi
    Shao, Tianjia
    Liu, Yong
    Zhou, Jingke
    Yang, Yin
    Wang, Jingdong
    Zhou, Kun
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [5] VersatileGaussian: Real-Time Neural Rendering for Versatile Tasks Using Gaussian Splatting
    Li, Renjie
    Fang, Zhiwen
    Wang, Bohua
    Wang, Peihao
    Wang, Zhangyang
    Wu, Xi
    COMPUTER VISION - ECCV 2024, PT XX, 2025, 15078 : 258 - 275
  • [6] Real-time Large-scale Deformation of Gaussian Splatting
    Gao, Lin
    Yang, Jie
    Zhang, Bo-tao
    Sun, Jia-mu
    Yuan, Yu-jie
    Fu, Hongbo
    Lai, Yu-kun
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (06):
  • [7] CaRtGS: Computational Alignment for Real-Time Gaussian Splatting SLAM
    Feng, Dapeng
    Chen, Zhiqiang
    Yin, Yizhen
    Zhong, Shipeng
    Qi, Yuhua
    Chen, Hongbo
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (05): : 4340 - 4347
  • [8] Gaussian in the Dark: Real-Time View Synthesis From Inconsistent Dark Images Using Gaussian Splatting
    Ye, Sheng
    Dong, Zhen-Hui
    Hu, Yubin
    Wen, Yu-Hui
    Liu, Yong-Jin
    COMPUTER GRAPHICS FORUM, 2024, 43 (07)
  • [9] FSGS: Real-Time Few-Shot View Synthesis Using Gaussian Splatting
    Zhu, Zehao
    Fan, Zhiwen
    Jiang, Yifan
    Wan, Zhangyang
    COMPUTER VISION - ECCV 2024, PT XXXIX, 2025, 15097 : 145 - 163
  • [10] MobileFusion: Real-time Volumetric Surface Reconstruction and Dense Tracking On Mobile Phones
    Ondruska, Peter
    Kohli, Pushmeet
    Izadi, Shahram
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (11) : 1251 - 1258