LiverNet: efficient and robust deep learning model for automatic diagnosis of sub-types of liver hepatocellular carcinoma cancer from H&E stained liver histopathology images

被引:43
|
作者
Aatresh, Anirudh Ashok [1 ]
Alabhya, Kumar [1 ]
Lal, Shyam [1 ]
Kini, Jyoti [2 ,3 ]
Saxena, P. U. Prakash [3 ,4 ]
机构
[1] Natl Inst Technol Karnataka, Dept Elect & Commun Engn, Mangaluru 575025, Karnataka, India
[2] Kasturba Med Coll & Hosp, Dept Pathol, Mangalore, India
[3] Manipal Acad Higher Educ, Manipal, Karnataka, India
[4] Kasturba Med Coll & Hosp, Dept Radiotherapy & Oncol, Mangalore, India
关键词
Convolutional neural network; Deep learning; HCC histopathology images; Medical image classification; Liver cancer grading;
D O I
10.1007/s11548-021-02410-4
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Liver cancer is one of the most common types of cancers in Asia with a high mortality rate. A common method for liver cancer diagnosis is the manual examination of histopathology images. Due to its laborious nature, we focus on alternate deep learning methods for automatic diagnosis, providing significant advantages over manual methods. In this paper, we propose a novel deep learning framework to perform multi-class cancer classification of liver hepatocellular carcinoma (HCC) tumor histopathology images which shows improvements in inference speed and classification quality over other competitive methods. Method The BreastNet architecture proposed by Togacar et al. shows great promise in using convolutional block attention modules (CBAM) for effective cancer classification in H&E stained breast histopathology images. As part of our experiments with this framework, we have studied the addition of atrous spatial pyramid pooling (ASPP) blocks to effectively capture multi-scale features in H&E stained liver histopathology data. We classify liver histopathology data into four classes, namely the non-cancerous class, low sub-type liver HCC tumor, medium sub-type liver HCC tumor, and high sub-type liver HCC tumor. To prove the robustness and efficacy of our models, we have shown results for two liver histopathology datasets-a novel KMC dataset and the TCGA dataset. Results Our proposed architecture outperforms state-of-the-art architectures for multi-class cancer classification of HCC histopathology images, not just in terms of quality of classification, but also in computational efficiency on the novel proposed KMC liver data and the publicly available TCGA-LIHC dataset. We have considered precision, recall, F1-score, intersection over union (IoU), accuracy, number of parameters, and FLOPs as metrics for comparison. The results of our meticulous experiments have shown improved classification performance along with added efficiency. LiverNet has been observed to outperform all other frameworks in all metrics under comparison with an approximate improvement of 2% in accuracy and F1-score on the KMC and TCGA-LIHC datasets. Conclusion To the best of our knowledge, our work is among the first to provide concrete proof and demonstrate results for a successful deep learning architecture to handle multi-class HCC histopathology image classification among various sub-types of liver HCC tumor. Our method shows a high accuracy of 90.93% on the proposed KMC liver dataset requiring only 0.5739 million parameters and 1.1934 million floating point operations per second.
引用
收藏
页码:1549 / 1563
页数:15
相关论文
共 13 条
  • [1] LiverNet: efficient and robust deep learning model for automatic diagnosis of sub-types of liver hepatocellular carcinoma cancer from H&E stained liver histopathology images
    Anirudh Ashok Aatresh
    Kumar Alabhya
    Shyam Lal
    Jyoti Kini
    PU Prakash Saxena
    International Journal of Computer Assisted Radiology and Surgery, 2021, 16 : 1549 - 1563
  • [2] Evolution of LiverNet 2.x: Architectures for automated liver cancer grade classification from H&E stained liver histopathological images
    Chanchal, Amit Kumar
    Lal, Shyam
    Barnwal, Dipanshu
    Sinha, Prince
    Arvavasu, Shrikant
    Kini, Jyoti
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (1) : 2791 - 2821
  • [3] Evolution of LiverNet 2.x: Architectures for automated liver cancer grade classification from H&E stained liver histopathological images
    Amit Kumar Chanchal
    Shyam Lal
    Dipanshu Barnwal
    Prince Sinha
    Shrikant Arvavasu
    Jyoti Kini
    Multimedia Tools and Applications, 2024, 83 : 2791 - 2821
  • [4] Classification and mutation prediction based on histopathology H&E images in liver cancer using deep learning
    Mingyu Chen
    Bin Zhang
    Win Topatana
    Jiasheng Cao
    Hepan Zhu
    Sarun Juengpanich
    Qijiang Mao
    Hong Yu
    Xiujun Cai
    npj Precision Oncology, 4
  • [5] Classification and mutation prediction based on histopathology H&E images in liver cancer using deep learning
    Chen, Mingyu
    Zhang, Bin
    Topatana, Win
    Cao, Jiasheng
    Zhu, Hepan
    Juengpanich, Sarun
    Mao, Qijiang
    Yu, Hong
    Cai, Xiujun
    NPJ PRECISION ONCOLOGY, 2020, 4 (01)
  • [6] Human Hepatocellular Carcinoma Classification from H&E Stained Histopathology Images with 3D Convolutional Neural Networks and Focal Loss Function
    Cinar, Umut
    Atalay, Rengul Cetin
    Cetin, Yasemin Yardimci
    JOURNAL OF IMAGING, 2023, 9 (02)
  • [7] Molecular classification of endometrial cancer from H&E stained slide images using supervised deep learning: a proof of concept
    Aguirre Neira, Fabiana Ines
    Rodriguez, V. E.
    Legoburu, A. A.
    Llanos, A. R.
    Carrera Salas, R.
    Jimenez Bolance, O.
    Ferreres Pinas, J. C.
    Costa Trachsel, I.
    VIRCHOWS ARCHIV, 2024, 485 : S47 - S47
  • [8] Deep Learning Identifies Microsatellite Instability in H&E Whole Slide Images from Prostate, Esophageal, and Gastric Cancers and Generalizes across Cancer Types
    Joshi, Rohan
    Kruger, Andrew
    Moore, Elle
    Jones, Ryan
    Stumpe, Martin
    MODERN PATHOLOGY, 2022, 35 (SUPPL 2) : 1078 - 1079
  • [9] Deep Learning Identifies Microsatellite Instability in H&E Whole Slide Images from Prostate, Esophageal, and Gastric Cancers and Generalizes across Cancer Types
    Joshi, Rohan
    Kruger, Andrew
    Moore, Elle
    Jones, Ryan
    Stumpe, Martin
    LABORATORY INVESTIGATION, 2022, 102 (SUPPL 1) : 1078 - 1079
  • [10] Deep learning-based image analysis predicts PD-L1 status from H&E-stained histopathology images in breast cancer
    Shamai, Gil
    Livne, Amir
    Polonia, Antonio
    Sabo, Edmond
    Cretu, Alexandra
    Bar-Sela, Gil
    Kimmel, Ron
    NATURE COMMUNICATIONS, 2022, 13 (01)