Artificial Intelligence for Surgical Safety Automatic Assessment of the Critical View of Safety in Laparoscopic Cholecystectomy Using Deep Learning

被引:114
|
作者
Mascagni, Pietro [1 ,2 ]
Vardazaryan, Armine [1 ]
Alapatt, Deepak [1 ]
Urade, Takeshi [3 ]
Emre, Taha [1 ]
Fiorillo, Claudio [2 ]
Pessaux, Patrick [3 ,4 ,5 ]
Mutter, Didier [4 ,5 ]
Marescaux, Jacques [4 ]
Costamagna, Guido [2 ]
Dallemagne, Bernard [4 ,5 ]
Padoy, Nicolas [1 ]
机构
[1] Univ Strasbourg, CNRS, ICube, IHU Strasbourg, Strasbourg, France
[2] Fdn Policlin Univ A Gemelli IRCCS, Rome, Italy
[3] IHU Strasbourg, Inst Image Guided Surg, Strasbourg, France
[4] Inst Res Digest Canc IRCAD, Strasbourg, France
[5] Univ Strasbourg, Dept Digest & Endocrine Surg, Strasbourg, France
关键词
anatomical segmentation; artificial intelligence; computer vision; critical view of safety; deep learning; laparoscopic cholecystectomy; surgical data science; surgical safety; INTRAOPERATIVE ADVERSE EVENTS; GENERATION; INJURY;
D O I
10.1097/SLA.0000000000004351
中图分类号
R61 [外科手术学];
学科分类号
摘要
Objective: To develop a deep learning model to automatically segment hepatocystic anatomy and assess the criteria defining the critical view of safety (CVS) in laparoscopic cholecystectomy (LC). Background: Poor implementation and subjective interpretation of CVS contributes to the stable rates of bile duct injuries in LC. As CVS is assessed visually, this task can be automated by using computer vision, an area of artificial intelligence aimed at interpreting images. Methods: Still images from LC videos were annotated with CVS criteria and hepatocystic anatomy segmentation. A deep neural network comprising a segmentation model to highlight hepatocystic anatomy and a classification model to predict CVS criteria achievement was trained and tested using 5-fold cross validation. Intersection over union, average precision, and balanced accuracy were computed to evaluate the model performance versus the annotated ground truth. Results: A total of 2854 images from 201 LC videos were annotated and 402 images were further segmented. Mean intersection over union for segmentation was 66.6%. The model assessed the achievement of CVS criteria with a mean average precision and balanced accuracy of 71.9% and 71.4%, respectively. Conclusions: Deep learning algorithms can be trained to reliably segment hepatocystic anatomy and assess CVS criteria in still laparoscopic images. Surgical-technical partnerships should be encouraged to develop and evaluate deep learning models to improve surgical safety.
引用
收藏
页码:955 / 961
页数:7
相关论文
共 50 条
  • [1] Use of artificial intelligence in the detection of the critical view of safety during laparoscopic cholecystectomy
    Petracchi, Enrique J.
    Olivieri, Sean E.
    Varela, Jose
    Canullan, Carlos M.
    Zandalazini, Hugo
    Ocampo, Carlos
    Quesada, Bernabe M.
    [J]. JOURNAL OF GASTROINTESTINAL SURGERY, 2024, 28 (06) : 877 - 879
  • [2] Automated Prediction of Critical View of Safety Criteria in Laparoscopic Cholecystectomy Using Deep Learning
    Hegde, Shruti
    Namazi, Babak
    Mahnken, Heidi
    Dumas, Ryan
    Sankaranarayana, Ganesh
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS, 2022, 235 (05) : S71 - S71
  • [3] Formalizing video documentation of the Critical View of Safety in laparoscopic cholecystectomy: a step towards artificial intelligence assistance to improve surgical safety
    Pietro Mascagni
    Claudio Fiorillo
    Takeshi Urade
    Taha Emre
    Tong Yu
    Taiga Wakabayashi
    Emanuele Felli
    Silvana Perretta
    Lee Swanstrom
    Didier Mutter
    Jacques Marescaux
    Patrick Pessaux
    Guido Costamagna
    Nicolas Padoy
    Bernard Dallemagne
    [J]. Surgical Endoscopy, 2020, 34 : 2709 - 2714
  • [4] Formalizing video documentation of the Critical View of Safety in laparoscopic cholecystectomy: a step towards artificial intelligence assistance to improve surgical safety
    Mascagni, Pietro
    Fiorillo, Claudio
    Urade, Takeshi
    Emre, Taha
    Yu, Tong
    Wakabayashi, Taiga
    Felli, Emanuele
    Perretta, Silvana
    Swanstrom, Lee
    Mutter, Didier
    Marescaux, Jacques
    Pessaux, Patrick
    Costamagna, Guido
    Padoy, Nicolas
    Dallemagne, Bernard
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2020, 34 (06): : 2709 - 2714
  • [5] Development of an artificial intelligence system for real-time intraoperative assessment of the Critical View of Safety in laparoscopic cholecystectomy
    Kawamura, Masahiro
    Endo, Yuichi
    Fujinaga, Atsuro
    Orimoto, Hiroki
    Amano, Shota
    Kawasaki, Takahide
    Kawano, Yoko
    Masuda, Takashi
    Hirashita, Teijiro
    Kimura, Misako
    Ejima, Aika
    Matsunobu, Yusuke
    Shinozuka, Ken'ichi
    Tokuyasu, Tatsushi
    Inomata, Masafumi
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2023, 37 (11): : 8755 - 8763
  • [6] Development of an artificial intelligence system for real-time intraoperative assessment of the Critical View of Safety in laparoscopic cholecystectomy
    Masahiro Kawamura
    Yuichi Endo
    Atsuro Fujinaga
    Hiroki Orimoto
    Shota Amano
    Takahide Kawasaki
    Yoko Kawano
    Takashi Masuda
    Teijiro Hirashita
    Misako Kimura
    Aika Ejima
    Yusuke Matsunobu
    Ken’ichi Shinozuka
    Tatsushi Tokuyasu
    Masafumi Inomata
    [J]. Surgical Endoscopy, 2023, 37 (11) : 8755 - 8763
  • [7] Surgical quality assessment of critical view of safety in 283 laparoscopic cholecystectomy videos by surgical residents and surgeons
    Gruter, Alexander A. J.
    Daams, Freek
    Bonjer, Hendrik J.
    van Duijvendijk, Peter
    Tuynman, Jurriaan B.
    Jilesen, Anneke
    Blomberg, Bjoern
    Berndsen, Bob
    de Betue, Carlijn
    Henneman, Daan
    Sloothaak, Didi
    Wassenaar, Eelco
    Bruns, Emma
    Westerduin, Emma
    van Nieuwenhoven, Ernst-Jan
    Frans, Franceline
    Hoexum, Frank
    Prakken, Fred
    Musters, Gijs
    Jalalzadeh, Hamid
    Ebben, Harm
    Palamba, Harm Willem
    Atema, Jasper
    Posthuma, Jelle
    Dikken, Johan
    Govaert, Johannes
    van Hilst, Jony
    ten Brinke, Joost
    Volders, Jose
    de Leur, Kevin
    Govaert, Klaas
    van der Werf, Leonie
    Busweiler, Linde
    Goessens, Marco
    Bolster-van Eenennaam, Marieke
    van Dorp, Martijn
    Ayez, Ninos
    Karthaus, Noor
    Moerbeek, Patrick
    Johannesma, Paul
    Coelen, Robert-Jan
    Blok, Robin
    Bakx, Roel
    Mekke, Sander
    Gans, Sarah
    van Dijk, Stefan
    van der Ploeg, Stijn
    Poels, Thomas
    Coblijn, Usha
    Alberts, Victor
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2024, 38 (07): : 3609 - 3614
  • [8] Critical View of Safety for Safe Laparoscopic Cholecystectomy
    Dubhashi, Siddharth P.
    Jenaw, Ratnesh
    Dubhashi, Riddhima S.
    [J]. JOURNAL OF KRISHNA INSTITUTE OF MEDICAL SCIENCES UNIVERSITY, 2020, 9 (04) : 44 - 49
  • [9] Critical View of Safety During Laparoscopic Cholecystectomy
    Vettoretto, Nereo
    Saronni, Cristiano
    Harbi, Asaf
    Balestra, Luca
    Taglietti, Lucio
    Giovanetti, Maurizio
    [J]. JSLS-JOURNAL OF THE SOCIETY OF LAPAROENDOSCOPIC SURGEONS, 2011, 15 (03) : 322 - 325
  • [10] ASSESSMENT OF THE CRITICAL VIEW OF SAFETY FROM ONLINE VIDEOS OF LAPAROSCOPIC CHOLECYSTECTOMY
    Schimpke, Scott W.
    Deziel, Daniel J.
    Veenstra, Benjamin R.
    Kubasiak, John C.
    Minh, Luu B.
    [J]. GASTROENTEROLOGY, 2017, 152 (05) : S1234 - S1234