MVPCL: multi-view prototype consistency learning for semi-supervised medical image segmentation

被引:0
|
作者
Li, Xiafan [1 ]
Quan, Hongyan [1 ]
机构
[1] East China Normal Univ, Sch Comp Sci & Technol, Shanghai 200062, Peoples R China
来源
关键词
Multi-view; Consistency regularization; Prototype fusion; Semi-supervised segmentation; Cross-view attention; TRANSFORMER; NET;
D O I
10.1007/s00371-024-03497-x
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Semi-supervised learning (SSL) methods show their powerful performance in dealing with the issue of data shortage in the field of medical image segmentation. However, most existing SSL methods neither fully utilize the multi-view information of medical images nor generate high-quality pseudo-labels to expand the training set. In this study, we propose a multi-view prototype consistency learning (MVPCL) framework for semi-supervised medical image segmentation. Specifically, the multi-view encoder and cross-view attention mechanism are employed to obtain high-level latent features of the original volumes, and the consistency constraints on the predictions of multi-view inputs enhance the performance of the networks. Moreover, the fused prototype representations are learned from the entire dataset by adopting an entropy-based uncertainty map. Eventually, the consistency constraints on prototype-based predictions result in a more representative prototype for each class, thereby optimizing the embedding space distribution. Substantial experimental results on three public benchmark datasets, including LiTS, LA, and ACDC, demonstrate the efficacy of the proposed method compared to the existing approaches. The source code is available at https://github.com/lixiafan/MVPCL-master.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multi-view semi-supervised learning for image classification
    Zhu, Songhao
    Sun, Xian
    Jin, Dongliang
    [J]. NEUROCOMPUTING, 2016, 208 : 136 - 142
  • [2] Consistency and adversarial semi-supervised learning for medical image segmentation
    Tang, Yongqiang
    Wang, Shilei
    Qu, Yuxun
    Cui, Zhihua
    Zhang, Wensheng
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 161
  • [3] Mutual consistency learning for semi-supervised medical image segmentation
    Wu, Yicheng
    Ge, Zongyuan
    Zhang, Donghao
    Xu, Minfeng
    Zhang, Lei
    Xia, Yong
    Cai, Jianfei
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 81
  • [4] UPCoL: Uncertainty-Informed Prototype Consistency Learning for Semi-supervised Medical Image Segmentation
    Lu, Wenjing
    Lei, Jiahao
    Qiu, Peng
    Sheng, Rui
    Zhou, Jinhua
    Lu, Xinwu
    Yang, Yang
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV, 2023, 14223 : 662 - 672
  • [5] Multi-View Semi-Supervised Learning Based Image Annotation
    Sun, Chengjian
    Zhu, Songhao
    Shi, Zhe
    [J]. MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS, 2014, 1049 : 1486 - 1489
  • [6] Multi-view Semi-supervised Learning for Web Image Annotation
    Hu, Mengqiu
    Yang, Yang
    Zhang, Hanwang
    Shen, Fumin
    Shao, Jie
    Zou, Fuhao
    [J]. MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 947 - 950
  • [7] Multidimensional perturbed consistency learning for semi-supervised medical image segmentation
    Yuan, Enze
    Zhao, Bin
    Qin, Xiao
    Ding, Shuxue
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (03)
  • [8] Multi-View Semi-Supervised Learning for Dialog Act Segmentation of Speech
    Guz, Umit
    Cuendet, Sebastien
    Hakkani-Tuer, Dilek
    Tur, Gokhan
    [J]. IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2010, 18 (02): : 320 - 329
  • [9] Decoupled Consistency for Semi-supervised Medical Image Segmentation
    Chen, Faquan
    Fei, Jingjing
    Chen, Yaqi
    Huang, Chenxi
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 551 - 561
  • [10] View Construction for Multi-view Semi-supervised Learning
    Sun, Shiliang
    Jin, Feng
    Tu, Wenting
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT I, 2011, 6675 : 595 - 601