Multi-scale information with attention integration for classification of liver fibrosis in B-mode US image

被引:14
|
作者
Feng, Xiangfei [1 ]
Chen, Xin [2 ]
Dong, Changfeng [3 ]
Liu, Yingxia [3 ]
Liu, Zhong [2 ]
Ding, Ruixin [4 ]
Huang, Qinghua [5 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510640, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound, Guangdong Key Lab Biomed Measurements & Ultrasoun, Shenzhen 518055, Peoples R China
[3] Shenzhen Third Peoples Hosp, Shenzhen Inst Hepatol, Shenzhen 518020, Peoples R China
[4] Guangzhou Inst Technol, Guangzhou 510075, Guangdong, Peoples R China
[5] Northwestern Polytech Univ, Sch Artificial Intelligence, Optic & Elect iOPEN, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Liver fibrosis; US image; Multi-scale information; Attention maps; MAGNETIC-RESONANCE ELASTOGRAPHY; SHEAR-WAVE ELASTOGRAPHY;
D O I
10.1016/j.cmpb.2021.106598
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and objective: Chronic hepatitis B (CHB) is one of the most common liver diseases in the world, which threats a lot to people's usual life. The increased deposition of fibrotic tissues in livers for patients with CHB may lead to the development of liver cirrhosis, hepatocellular carcinoma, or even liver failure. Accurate fibrosis staging is very important for the targeted treatment of liver fibrosis and its recovery. Methods: In this paper, we propose a new deep convolutional neural network (DCNN) with functions of multi-scale information extraction and attention integration for more accurate liver fibrosis classification from ultrasound (US) images. The proposed network uses two pyramid-structured CNN elements to extract multi-scale features from US images. Such a design significantly enlarges the receptive field of the convolution layer, such that more useful information can be explored by the neural network to associate with the final classification. Based on this, a new feature distillation method is also proposed to enhance the ability of deep features derived from multi-scale information. The proposed distillation method employs attention maps to automatically extract class-related features from multi-scale information, which effectively suppress the influence of potential distractors. Results: Experimental results on the US liver fibrosis dataset collected from 286 participants show that the proposed deep framework achieves promising classification performance. The proposed method achieves a classification accuracy of 95.66% on the test dataset. Conclusion: Our proposed framework could stage liver fibrosis highly accurately. It might provide effective suggestions for the clinical treatment of liver fibrosis that can facilitate its recovery. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] CONTEXTUAL MULTI-SCALE IMAGE CLASSIFICATION ON QUADTREE
    Hedhli, Ihsen
    Moser, Gabriele
    Serpico, Sebastiano B.
    Zerubia, Josiane
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1349 - 1353
  • [32] IMAGE CLASSIFICATION METHOD WITH MULTI-SCALE FEATURES
    Lu, Peng
    Zou, Peiqi
    Zou, Guoliang
    Zheng, Zongsheng
    Zou, Peiqi
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2019, 20 (06) : 1183 - 1191
  • [33] Combining Multi-Scale Dissimilarities for Image Classification
    Li, Yan
    Duin, Robert P. W.
    Loog, Marco
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 1639 - 1642
  • [34] MULTI-SCALE RESIDUAL NETWORK FOR IMAGE CLASSIFICATION
    Zhong, Xian
    Gong, Oubo
    Huang, Wenxin
    Yuan, Jingling
    Ma, Bo
    Li, Ryan Wen
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2023 - 2027
  • [35] Multi-Scale Self-Attention for Text Classification
    Guo, Qipeng
    Qiu, Xipeng
    Liu, Pengfei
    Xue, Xiangyang
    Zhang, Zheng
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 7847 - 7854
  • [36] Multi-Scale Attention Network for Diabetic Retinopathy Classification
    Al-Antary, Mohammad T.
    Arafa, Yasmine
    IEEE ACCESS, 2021, 9 : 54190 - 54200
  • [37] Multi-Scale and Attention based ResNet for Heartbeat Classification
    Zhang, Haojie
    Yang, Gongping
    Huang, Yuwen
    Yuan, Feng
    Yin, Yilong
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1529 - 1535
  • [38] Multi-Scale Information Can Do More: Attention Aggregation Mechanism for Image Compression
    Li, Bo
    Li, Yongjun
    Li, Yao
    Luo, Jincheng
    Li, Chaoyue
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 348 - 348
  • [39] Multi-scale Information Assembly for Image Matting
    Qiao, Yu
    Liu, Yuhao
    Zhu, Qiang
    Yang, Xin
    Wang, Yuxin
    Zhang, Qiang
    Wei, Xiaopeng
    COMPUTER GRAPHICS FORUM, 2020, 39 (07) : 565 - 574
  • [40] STACKED MULTI-SCALE ATTENTION NETWORK FOR IMAGE COLORIZATION
    Jiang, Bin
    Xu, Fangqiang
    Xia, Jun
    Yang, Chao
    Huang, Wei
    Huang, Yun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2225 - 2229