Multi-scale information with attention integration for classification of liver fibrosis in B-mode US image

被引:14
|
作者
Feng, Xiangfei [1 ]
Chen, Xin [2 ]
Dong, Changfeng [3 ]
Liu, Yingxia [3 ]
Liu, Zhong [2 ]
Ding, Ruixin [4 ]
Huang, Qinghua [5 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510640, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound, Guangdong Key Lab Biomed Measurements & Ultrasoun, Shenzhen 518055, Peoples R China
[3] Shenzhen Third Peoples Hosp, Shenzhen Inst Hepatol, Shenzhen 518020, Peoples R China
[4] Guangzhou Inst Technol, Guangzhou 510075, Guangdong, Peoples R China
[5] Northwestern Polytech Univ, Sch Artificial Intelligence, Optic & Elect iOPEN, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Liver fibrosis; US image; Multi-scale information; Attention maps; MAGNETIC-RESONANCE ELASTOGRAPHY; SHEAR-WAVE ELASTOGRAPHY;
D O I
10.1016/j.cmpb.2021.106598
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and objective: Chronic hepatitis B (CHB) is one of the most common liver diseases in the world, which threats a lot to people's usual life. The increased deposition of fibrotic tissues in livers for patients with CHB may lead to the development of liver cirrhosis, hepatocellular carcinoma, or even liver failure. Accurate fibrosis staging is very important for the targeted treatment of liver fibrosis and its recovery. Methods: In this paper, we propose a new deep convolutional neural network (DCNN) with functions of multi-scale information extraction and attention integration for more accurate liver fibrosis classification from ultrasound (US) images. The proposed network uses two pyramid-structured CNN elements to extract multi-scale features from US images. Such a design significantly enlarges the receptive field of the convolution layer, such that more useful information can be explored by the neural network to associate with the final classification. Based on this, a new feature distillation method is also proposed to enhance the ability of deep features derived from multi-scale information. The proposed distillation method employs attention maps to automatically extract class-related features from multi-scale information, which effectively suppress the influence of potential distractors. Results: Experimental results on the US liver fibrosis dataset collected from 286 participants show that the proposed deep framework achieves promising classification performance. The proposed method achieves a classification accuracy of 95.66% on the test dataset. Conclusion: Our proposed framework could stage liver fibrosis highly accurately. It might provide effective suggestions for the clinical treatment of liver fibrosis that can facilitate its recovery. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Multi-Scale Context Attention Network for Image Retrieval
    Lou, Yihang
    Bai, Yan
    Wang, Shiqi
    Duan, Ling-Yu
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1128 - 1136
  • [42] Image Inpainting with EMMA Attention and Multi-scale Fusion
    Wei, Yun
    Wang, Lulu
    Wu, Kaijun
    Shan, Hongquan
    Tian, Bin
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2024, 51 (12): : 87 - 97
  • [43] Multi-scale attention in attention neural network for single image deblurring☆
    Lee, Ho Sub
    Cho, Sung In
    DISPLAYS, 2024, 85
  • [44] Multi-scale texture-based level-set segmentation of breast B-mode images
    Lang, Itai
    Sklair-Levy, Miri
    Spitzer, Hedva
    COMPUTERS IN BIOLOGY AND MEDICINE, 2016, 72 : 30 - 42
  • [45] Remote Sensing Image Scene Classification Method Based on Multi-Scale Cyclic Attention Network
    Ma X.
    Wang L.
    Qi K.
    Zheng G.
    Diqiu Kexue - Zhongguo Dizhi Daxue Xuebao/Earth Science - Journal of China University of Geosciences, 2021, 46 (10): : 3740 - 3752
  • [46] Recursive Multi-Scale Channel-Spatial Attention for Fine-Grained Image Classification
    Liu, Dichao
    Wang, Yu
    Mase, Kenji
    Kato, Jien
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (03) : 713 - 726
  • [47] Bi-directional LSTM with multi-scale dense attention mechanism for hyperspectral image classification
    Jinxiong Gao
    Xiumei Gao
    Nan Wu
    Hongye Yang
    Multimedia Tools and Applications, 2022, 81 : 24003 - 24020
  • [48] A Recurrent Attention Multi-Scale CNN-LSTM Network Based on Hyperspectral Image Classification
    Zhang, Xinyue
    Zuo, Jing
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2023, 32 (11)
  • [49] Multi-Scale Spatial Perception Attention Network for Few-Shot Hyperspectral Image Classification
    Li, Yang
    Luo, Jian
    Long, Haoyu
    Jin, Qianqian
    IEEE ACCESS, 2024, 12 : 173076 - 173090
  • [50] Bi-directional LSTM with multi-scale dense attention mechanism for hyperspectral image classification
    Gao, Jinxiong
    Gao, Xiumei
    Wu, Nan
    Yang, Hongye
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (17) : 24003 - 24020