Annotation Cost Minimization for Ultrasound Image Segmentation Using Cross-Domain Transfer Learning

被引:2
|
作者
Monkam, Patrice [1 ,2 ,3 ]
Jin, Songbai [1 ,2 ,3 ]
Lu, Wenkai [1 ,2 ,3 ]
机构
[1] Tsinghua Univ, Dept Automation, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRist, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Inst Precis Med, Beijing 100084, Peoples R China
基金
北京市自然科学基金;
关键词
Annotated data generation; SegMix; annotation cost reduction; deep learning; US image segmentation;
D O I
10.1109/JBHI.2023.3236989
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning techniques can help minimize inter-physician analysis variability and the medical expert workloads, thereby enabling more accurate diagnoses. However, their implementation requires large-scale annotated dataset whose acquisition incurs heavy time and human-expertise costs. Hence, to significantly minimize the annotation cost, this study presents a novel framework that enables the deployment of deep learning methods in ultrasound (US) image segmentation requiring only very limited manually annotated samples. We propose SegMix, a fast and efficient approach that exploits a segment-paste-blend concept to generate large number of annotated samples based on a few manually acquired labels. Besides, a series of US-specific augmentation strategies built upon image enhancement algorithms are introduced to make maximum use of the available limited number of manually delineated images. The feasibility of the proposed framework is validated on the left ventricle (LV) segmentation and fetal head (FH) segmentation tasks, respectively. Experimental results demonstrate that using only 10 manually annotated images, the proposed framework can achieve a Dice and JI of 82.61% and 83.92%, and 88.42% and 89.27% for LV segmentation and FH segmentation, respectively. Compared with training using the entire training set, there is over 98% of annotation cost reduction while achieving comparable segmentation performance. This indicates that the proposed framework enables satisfactory deep leaning performance when very limited number of annotated samples is available. Therefore, we believe that it can be a reliable solution for annotation cost reduction in medical image analysis.
引用
下载
收藏
页码:2015 / 2025
页数:11
相关论文
共 50 条
  • [31] Assessment of operating performance using cross-domain feature transfer learning
    Zou, Xiaoyu
    Wang, Fuli
    Chang, Yuqing
    CONTROL ENGINEERING PRACTICE, 2019, 89 : 143 - 153
  • [32] Learning Unsupervised Cross-domain Image-to-Image Translation using a Shared Discriminator
    Kumar, Rajiv
    Dabral, Rishabh
    Sivakumar, G.
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 256 - 264
  • [33] From Image Transfer to Object Transfer: Cross-Domain Instance Segmentation Based on Center Point Feature Alignment
    Wang, Jin
    Ji, Shunping
    Zhang, Tao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [34] Multi-region saliency-aware learning for cross-domain placenta image segmentation
    Zhang, Zhuomin
    Davaasuren, Dolzodmaa
    Wu, Chenyan
    Goldstein, Jeffery A.
    Gernand, Alison D.
    Wang, James Z.
    PATTERN RECOGNITION LETTERS, 2020, 140 : 165 - 171
  • [35] Cross-domain collaborative learning for single image deraining
    Pan, Zaiyu
    Wang, Jun
    Shen, Zhengwen
    Han, Shuyu
    Zhu, Jihong
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 211
  • [36] Discriminative Style Learning for Cross-Domain Image Captioning
    Yuan, Jin
    Zhu, Shuai
    Huang, Shuyin
    Zhang, Hanwang
    Xiao, Yaoqiang
    Li, Zhiyong
    Wang, Meng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1723 - 1736
  • [37] Cross-Domain Contrastive Learning for Hyperspectral Image Classification
    Guan, Peiyan
    Lam, Edmund Y.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [38] Cross-Domain Scene Unsupervised Learning Segmentation With Dynamic Subdomains
    He, Pei
    Jiao, Licheng
    Liu, Fang
    Liu, Xu
    Shang, Ronghua
    Wang, Shuang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6770 - 6784
  • [39] Prototypical Bidirectional Adaptation and Learning for Cross-Domain Semantic Segmentation
    Ren, Qinghua
    Mao, Qirong
    Lu, Shijian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 501 - 513
  • [40] Learning Instance-Specific Adaptation for Cross-Domain Segmentation
    Zou, Yuliang
    Zhang, Zizhao
    Li, Chun-Liang
    Zhang, Han
    Pfister, Tomas
    Huang, Jia-Bin
    COMPUTER VISION - ECCV 2022, PT XXXIII, 2022, 13693 : 459 - 476