Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning

被引:1
|
作者
Xie, Xuanhua [1 ,2 ,3 ]
Fan, Huijie [2 ,3 ]
Yu, Zhencheng [2 ,3 ]
Bai, Haijun [1 ]
Tang, Yandong [2 ,3 ]
机构
[1] Shenyang Univ Chem Technol, Coll Informat Engn, Shenyang 110142, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[3] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110016, Peoples R China
基金
中国国家自然科学基金;
关键词
Weakly supervised semantic segmentation; Multi-task learning; Graph convolution;
D O I
10.1007/978-3-031-13822-5_35
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Medical image segmentation plays an important role in the diagnosis and treatment of diseases. Using fully supervised deep learning methods for medical image segmentation requires large medical image datasets with pixel-level annotations, but medical image annotation is time-consuming and labor-intensive. On this basis, we study a medical image segmentation algorithm based on image-level annotation. Existing weakly supervised semantic segmentation algorithms based on image-level annotations rely on class activation maps (CAM) and saliency maps generated by preprocessing as pseudo-labels to supervise the network. However, the CAMs generated by many existing methods are often overactivated or under-activated, while most of the saliency map generated by preprocessing is also rough and cannot be updated online, which will affect the segmentation effect. In response to this situation, we study a weakly supervised medical image segmentation algorithm based on multi-task learning, which uses graph convolution to correct for improper activation, and uses similarity learning to update pseudo-labels online to improve segmentation performance. We conducted extensive experiments on ISIC2017 skin disease images to validate the proposed method and experiments show that our method achieves a Dice evaluation metric of 68.38% on this dataset, show that our approach outperforms state-of-the-art methods.
引用
收藏
页码:395 / 404
页数:10
相关论文
共 50 条
  • [1] Weakly Supervised Multi-Task Learning for Cell Detection and Segmentation
    Chamanzar, Alireza
    Nie, Yao
    [J]. 2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 513 - 516
  • [2] MULTI-TASK CURRICULUM LEARNING FOR SEMI-SUPERVISED MEDICAL IMAGE SEGMENTATION
    Wang, Kaiping
    Zhan, Bo
    Luo, Yanmei
    Zhou, Jiliu
    Wu, Xi
    Wang, Yan
    [J]. 2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 925 - 928
  • [3] Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation
    Chen, Shuai
    Bortsova, Gerda
    Juarez, Antonio Garcia-Uceda
    van Tulder, Gijs
    de Bruijne, Marleen
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 457 - 465
  • [4] Improving Weakly Supervised Lesion Segmentation using Multi-Task Learning
    Chu, Tianshu
    Li, Xinmeng
    Vo, Huy V.
    Summers, Ronald M.
    Sizikova, Elena
    [J]. MEDICAL IMAGING WITH DEEP LEARNING, VOL 143, 2021, 143 : 60 - 73
  • [5] Image segmentation fusion using weakly supervised trace-norm multi-task learning method
    Liang, Xianpeng
    Huang, De-Shuang
    [J]. IET IMAGE PROCESSING, 2018, 12 (07) : 1079 - 1085
  • [6] Towards Weakly-Supervised Text Spotting using a Multi-Task Transformer
    Kittenplon, Yair
    Lavi, Inbal
    Fogel, Sharon
    Bar, Yarin
    Manmatha, R.
    Perona, Pietro
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4594 - 4603
  • [7] An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation
    Wang, Kaiping
    Wang, Yan
    Zhan, Bo
    Yang, Yujie
    Zu, Chen
    Wu, Xi
    Zhou, Jiliu
    Nie, Dong
    Zhou, Luping
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2022, 32 (09)
  • [8] Weakly Supervised Multi-task Learning for Semantic Parsing
    Shao, Bo
    Gong, Yeyun
    Bao, Junwei
    Ji, Jianshu
    Cao, Guihong
    Lin, Xiaola
    Duan, Nan
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3375 - 3381
  • [9] Self-supervised multi-task learning for medical image analysis
    Yu, Huihui
    Dai, Qun
    [J]. PATTERN RECOGNITION, 2024, 150
  • [10] Weakly-Supervised Deep Learning Based Automatic Image Segmentation Via Deformable Image Registration
    Chi, W.
    Lu, W.
    Ma, L.
    Wu, J.
    Chen, H.
    Tan, M.
    Gu, X.
    [J]. MEDICAL PHYSICS, 2020, 47 (06) : E672 - E673