Tumor Margin Classification of Head and Neck Cancer Using Hyperspectral Imaging and Convolutional Neural Networks

被引:15
|
作者
Halicek, Martin [1 ,2 ,3 ]
Little, James V. [4 ]
Wang, Xu [5 ]
Patel, Mihir [6 ,7 ]
Griffith, Christopher C. [4 ]
Chen, Amy Y. [6 ,7 ]
Fei, Baowei [1 ,2 ,7 ,8 ,9 ]
机构
[1] Georgia Inst Technol, Atlanta, GA 30332 USA
[2] Emory Univ, Wallace H Coulter Dept Biomed Engn, Atlanta, GA 30322 USA
[3] Augusta Univ, Med Coll Georgia, Augusta, GA USA
[4] Emory Univ, Sch Med, Dept Pathol & Lab Med, Atlanta, GA 30322 USA
[5] Emory Univ, Sch Med, Dept Hematol & Med Oncol, Atlanta, GA USA
[6] Emory Univ, Sch Med, Dept Otolaryngol, Atlanta, GA 30322 USA
[7] Emory Univ, Winship Canc Inst, Atlanta, GA 30322 USA
[8] Emory Univ, Dept Math & Comp Sci, Atlanta, GA 30322 USA
[9] Emory Univ, Dept Radiol & Imaging Sci, Atlanta, GA 30322 USA
关键词
Hyperspectral imaging; convolutional neural network; deep learning; cancer margin detection; intraoperative imaging; head and neck surgery; head and neck cancer; SQUAMOUS-CELL CARCINOMA;
D O I
10.1117/12.2293167
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
One of the largest factors affecting disease recurrence after surgical cancer resection is negative surgical margins. Hyperspectral imaging (HSI) is an optical imaging technique with potential to serve as a computer aided diagnostic tool for identifying cancer in gross ex-vivo specimens. We developed a tissue classifier using three distinct convolutional neural network (CNN) architectures on HSI data to investigate the ability to classify the cancer margins from ex-vivo human surgical specimens, collected from 20 patients undergoing surgical cancer resection as a preliminary validation group. A new approach for generating the HSI ground truth using a registered histological cancer margin is applied in order to create a validation dataset. The CNN-based method classifies the tumor-normal margin of squamous cell carcinoma (SCCa) versus normal oral tissue with an area under the curve (AUC) of 0.86 for inter-patient validation, performing with 81% accuracy, 84% sensitivity, and 77% specificity. Thyroid carcinoma cancer-normal margins are classified with an AUC of 0.94 for inter-patient validation, performing with 90% accuracy, 91% sensitivity, and 88% specificity. Our preliminary results on a limited patient dataset demonstrate the predictive ability of HSI-based cancer margin detection, which warrants further investigation with more patient data and additional processing techniques to optimize the proposed deep learning method.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Optical Biopsy of Head and Neck Cancer Using Hyperspectral Imaging and Convolutional Neural Networks
    Halicek, Martin
    Little, James V.
    Wang, Xu
    Patel, Mihir
    Griffith, Christopher C.
    El-Deiry, Mark W.
    Chen, Amy Y.
    Fei, Baowei
    OPTICAL IMAGING, THERAPEUTICS, AND ADVANCED TECHNOLOGY IN HEAD AND NECK SURGERY AND OTOLARYNGOLOGY 2018, 2018, 10469
  • [2] Optical biopsy of head and neck cancer using hyperspectral imaging and convolutional neural networks
    Hahoek, Martin
    Little, James, V
    Wang, Xu
    Chen, Amy Y.
    Fei, Baowei
    JOURNAL OF BIOMEDICAL OPTICS, 2019, 24 (03)
  • [3] Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging
    Halicek, Martin
    Lu, Guolan
    Little, James V.
    Wang, Xu
    Patel, Mihir
    Griffith, Christopher C.
    El-Deiry, Mark W.
    Chen, Amy Y.
    Fei, Baowei
    JOURNAL OF BIOMEDICAL OPTICS, 2017, 22 (06)
  • [4] Classification of head and neck cancer from PET images using convolutional neural networks
    Hellstrom, Henri
    Liedes, Joonas
    Rainio, Oona
    Malaspina, Simona
    Kemppainen, Jukka
    Klen, Riku
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [5] Classification of head and neck cancer from PET images using convolutional neural networks
    Henri Hellström
    Joonas Liedes
    Oona Rainio
    Simona Malaspina
    Jukka Kemppainen
    Riku Klén
    Scientific Reports, 13
  • [6] Mineral Classification using Convolutional Neural Networks and SWIR Hyperspectral Imaging
    Cifuentes, Jose I.
    Arias, Luis E.
    Pirard, Eric
    Castillo, Fernando
    AI AND OPTICAL DATA SCIENCES V, 2024, 12903
  • [7] CLASSIFICATION OF HYPERSPECTRAL COLON CANCER IMAGES USING CONVOLUTIONAL NEURAL NETWORKS
    Mobilia, Sean
    Sirkeci-Mergen, Birsen
    Deal, Joshua
    Rich, Thomas C.
    Leavesley, Silas J.
    2019 IEEE DATA SCIENCE WORKSHOP (DSW), 2019, : 232 - 236
  • [8] Robust Tissue Differentiation in Head and Neck Cancer: Ex-vivo Study with Hyperspectral Imaging and Convolutional Neural Networks
    Lotfy, Mayar
    Zhang, Xiaohan
    Hauger, Christoph
    Giannantonio, Tommaso
    Alperovich, Anna
    Holm, Felix
    Navab, Nassir
    Boehm, Felix
    Schwamborn, Carolin
    Hoffmann, Thomas K.
    Schuler, Patrick J.
    OPTICS IN HEALTH CARE AND BIOMEDICAL OPTICS XIII, 2023, 12770
  • [9] Hyperspectral Image Classification using Convolutional Neural Networks
    Shambulinga, M.
    Sadashivappa, G.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (06) : 702 - 708
  • [10] Hyperspectral imaging for head and neck cancer detection: specular glare and variance of the tumor margin in surgical specimens
    Halicek, Martin
    Fabelo, Himar
    Ortega, Samuel
    Little, James, V
    Wang, Xu
    Chen, Amy Y.
    Callico, Gustavo Marrero
    Myers, Larry
    Sumer, Baran D.
    Fei, Baowei
    JOURNAL OF MEDICAL IMAGING, 2019, 6 (03)