EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries Using Gaussian Splatting

被引:0
|
作者
Wang, Kailing [1 ]
Yang, Chen [1 ]
Wang, Yuehao [2 ]
Li, Sikuang [1 ]
Wang, Yan [3 ]
Dou, Qi [2 ]
Yang, Xiaokang [1 ]
Shen, Wei [1 ]
机构
[1] Shanghai Jiao Tong Univ, AI Inst, MoE Key Lab Artificial Intelligence, Shanghai, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Ma Liu Shui, Hong Kong, Peoples R China
[3] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Endoscopic surgeries; SLAM; Real-time rendering; Tissue reconstruction; SLAM;
D O I
10.1007/978-3-031-72089-5_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications in endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates simplified Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments and surveys of surgeons show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://loping151.github.io/endogslam.
引用
收藏
页码:219 / 229
页数:11
相关论文
共 50 条
  • [21] MRI Reconstruction using Real-Time Motion Tracking: A Simulation Study
    Orchard, Jeff
    Staruch, Robert
    2008 42ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1-4, 2008, : 1910 - +
  • [22] Real-time body tracking using a Gaussian process latent variable model
    Hou, Shaobo
    Galata, Aphrodite
    Caillette, Fabrice
    Thacker, Neil
    Bromiley, Paul
    2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 928 - +
  • [23] HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting
    Dhamo, Helisa
    Nie, Yinyu
    Moreau, Arthur
    Song, Jifei
    Shaw, Richard
    Zhou, Yiren
    Perez-Pellitero, Eduardo
    COMPUTER VISION - ECCV 2024, PT II, 2025, 15060 : 459 - 476
  • [24] A dense connection based network for real-time object tracking
    Lu, Yuwei
    Yuan, Yuan
    Wang, Qi
    NEUROCOMPUTING, 2020, 410 : 229 - 236
  • [25] The Need 4 Speed in Real-Time Dense Visual Tracking
    Kowdle, Adarsh
    Rhemann, Christoph
    Fanello, Sean
    Tagliasacchi, Andrea
    Taylor, Jonathan
    Davidson, Philip
    Dou, Mingsong
    Guo, Kaiwen
    Keskin, Cem
    Khamis, Sameh
    Kim, David
    Tang, Danhang
    Tankovich, Vladimir
    Valentin, Julien
    Izadi, Shahram
    SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [26] Real-time dense 3D reconstruction and camera tracking via embedded planes representation
    Yanping Fu
    Qingan Yan
    Jie Liao
    Alix L. H. Chow
    Chunxia Xiao
    The Visual Computer, 2020, 36 : 2215 - 2226
  • [27] The Need 4 Speed in Real-Time Dense Visual Tracking
    Kowdle, Adarsh
    Rhemann, Christoph
    Fanello, Sean
    Tagliasacchi, Andrea
    Taylor, Jonathan
    Davidson, Philip
    Dou, Mingsong
    Guo, Kaiwen
    Keskin, Cem
    Khamis, Sameh
    Kim, David
    Tang, Danhang
    Tankovich, Vladimir
    Valentin, Julien
    Izadi, Shahram
    ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):
  • [28] Real-time dense 3D reconstruction and camera tracking via embedded planes representation
    Fu, Yanping
    Yan, Qingan
    Liao, Jie
    Chow, Alix L. H.
    Xiao, Chunxia
    VISUAL COMPUTER, 2020, 36 (10-12): : 2215 - 2226
  • [29] Real-time vision-based tracking and reconstruction
    Bleser, Gabriele
    Becker, Mario
    Stricker, Didier
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2007, 2 (2-3) : 161 - 175
  • [30] SkeletonFusion: Reconstruction and tracking of human body in real-time
    Xie, Liang
    Zhang, Xiaohu
    Xu, Yuhua
    Shang, Yang
    Yu, QiFeng
    OPTICS AND LASERS IN ENGINEERING, 2018, 110 : 80 - 88