Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information

被引:477
|
作者
Tajbakhsh, Nima [1 ]
Gurudu, Suryakanth R. [2 ]
Liang, Jianming [1 ]
机构
[1] Arizona State Univ, Dept Biomed Informat, Scottsdale, AZ 85259 USA
[2] Mayo Clin, Div Gastroenterol & Hepatol, Scottsdale, AZ 85259 USA
关键词
Optical colonoscopy; polyp detection; boundary classification; edge voting; detection latency; COMPUTER-AIDED DETECTION; CT COLONOGRAPHY; MISS RATE; COLORECTAL-CANCER; TEXTURE FEATURES; CLASSIFICATION; CURVATURE;
D O I
10.1109/TMI.2015.2487997
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents the culmination of our research in designing a system for computer-aided detection (CAD) of polyps in colonoscopy videos. Our system is based on a hybrid context-shape approach, which utilizes context information to remove non-polyp structures and shape information to reliably localize polyps. Specifically, given a colonoscopy image, we first obtain a crude edge map. Second, we remove non-polyp edges from the edge map using our unique feature extraction and edge classification scheme. Third, we localize polyp candidates with probabilistic confidence scores in the refined edge maps using our novel voting scheme. The suggested CAD system has been tested using two public polyp databases, CVC-ColonDB, containing 300 colonoscopy images with a total of 300 polyp instances from 15 unique polyps, and ASU-Mayo database, which is our collection of colonoscopy videos containing 19,400 frames and a total of 5,200 polyp instances from 10 unique polyps. We have evaluated our system using free-response receiver operating characteristic (FROC) analysis. At 0.1 false positives per frame, our system achieves a sensitivity of 88.0% for CVC-ColonDB and a sensitivity of 48% for the ASU-Mayo database. In addition, we have evaluated our system using a new detection latency analysis where latency is defined as the time from the first appearance of a polyp in the colonoscopy video to the time of its first detection by our system. At 0.05 false positives per frame, our system yields a polyp detection latency of 0.3 seconds.
引用
收藏
页码:630 / 644
页数:15
相关论文
共 50 条
  • [1] AUTOMATED POLYP DETECTION IN COLONOSCOPY VIDEOS USING IMAGE ENHANCEMENT AND SALIENCY DETECTION ALGORITHM
    Nisha, J. S.
    Gopi, V. P.
    Palanisamy, P.
    [J]. BIOMEDICAL ENGINEERING-APPLICATIONS BASIS COMMUNICATIONS, 2022, 34 (01):
  • [2] AUTOMATIC POLYP DETECTION IN COLONOSCOPY VIDEOS
    Yuan, Zijie
    IzadyYazdanabadi, Mohammadhassan
    Mokkapati, Divya
    Panvalkar, Rujuta
    Shin, Jae Y.
    Tajbakhsh, Nima
    Gurudu, Suryakanth
    Liang, Jianming
    [J]. MEDICAL IMAGING 2017: IMAGE PROCESSING, 2017, 10133
  • [3] Automated Polyp Classification of Gastroenteric Lesion in Colonoscopy Videos
    Vispute, Mohinee
    Bhandari, Smriti H.
    [J]. 2018 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2018, : 735 - 738
  • [4] Polyp detection in colonoscopy video using elliptical shape feature
    Hwang, Sae
    Oh, JungHwan
    Tavanapong, Wallapak
    Wong, Johnny
    de Groen, Piet C.
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 1029 - +
  • [5] AUTOMATIC POLYP DETECTION IN COLONOSCOPY VIDEOS USING AN ENSEMBLE OF CONVOLUTIONAL NEURAL NETWORKS
    Tajbakhsh, Nima
    Gurudu, Suryakanth R.
    Liang, Jianming
    [J]. 2015 IEEE 12TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2015, : 79 - 83
  • [6] Integrating Online and Offline Three-Dimensional Deep Learning for Automated Polyp Detection in Colonoscopy Videos
    Yu, Lequan
    Chen, Hao
    Dou, Qi
    Qin, Jing
    Heng, Pheng Ann
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2017, 21 (01) : 65 - 75
  • [7] POLYP DETECTION IN COLONOSCOPY VIDEOS BY BOOTSTRAPPING VIA TEMPORAL CONSISTENCY
    Ma, Ming
    Chen, Xuejin
    Sun, Bin
    [J]. 2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 1360 - 1363
  • [8] Automated polyp detection in the colorectum: a prospective study (with videos)
    Klare, Peter
    Sander, Christoph
    Prinzen, Martin
    Haller, Bernhard
    Nowack, Sebastian
    Abdelhafez, Mohamed
    Poszler, Alexander
    Brown, Hayley
    Wilhelm, Dirk
    Schmid, Roland M.
    von Delius, Stefan
    Wittenberg, Thomas
    [J]. GASTROINTESTINAL ENDOSCOPY, 2019, 89 (03) : 576 - +
  • [9] DEEP LEARNING FOR REAL-TIME AUTOMATED POLYP LOCALISATION IN COLONOSCOPY VIDEOS
    Ahmad, Omer F.
    Luengo, Imanol
    Herrera, Luis Garcia Peraza
    Brandao, Patrick
    Li, Wenqi
    Everson, Martin
    Haidry, Rehan
    Vega, Roser
    Seward, Ed
    Vercauteren, Tom
    Lovat, Laurence B.
    [J]. GUT, 2018, 67 : A13 - A14
  • [10] Keyframe Selection from Colonoscopy Videos to Enhance Visualization for Polyp Detection
    Sharma, Vanshali
    Sasmal, Pradipta
    Bhuyan, M. K.
    Das, Pradip K.
    [J]. 2022 26TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV), 2022, : 426 - 431