Annotation Cost Minimization for Ultrasound Image Segmentation Using Cross-Domain Transfer Learning

被引:2
|
作者
Monkam, Patrice [1 ,2 ,3 ]
Jin, Songbai [1 ,2 ,3 ]
Lu, Wenkai [1 ,2 ,3 ]
机构
[1] Tsinghua Univ, Dept Automation, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRist, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Inst Precis Med, Beijing 100084, Peoples R China
基金
北京市自然科学基金;
关键词
Annotated data generation; SegMix; annotation cost reduction; deep learning; US image segmentation;
D O I
10.1109/JBHI.2023.3236989
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning techniques can help minimize inter-physician analysis variability and the medical expert workloads, thereby enabling more accurate diagnoses. However, their implementation requires large-scale annotated dataset whose acquisition incurs heavy time and human-expertise costs. Hence, to significantly minimize the annotation cost, this study presents a novel framework that enables the deployment of deep learning methods in ultrasound (US) image segmentation requiring only very limited manually annotated samples. We propose SegMix, a fast and efficient approach that exploits a segment-paste-blend concept to generate large number of annotated samples based on a few manually acquired labels. Besides, a series of US-specific augmentation strategies built upon image enhancement algorithms are introduced to make maximum use of the available limited number of manually delineated images. The feasibility of the proposed framework is validated on the left ventricle (LV) segmentation and fetal head (FH) segmentation tasks, respectively. Experimental results demonstrate that using only 10 manually annotated images, the proposed framework can achieve a Dice and JI of 82.61% and 83.92%, and 88.42% and 89.27% for LV segmentation and FH segmentation, respectively. Compared with training using the entire training set, there is over 98% of annotation cost reduction while achieving comparable segmentation performance. This indicates that the proposed framework enables satisfactory deep leaning performance when very limited number of annotated samples is available. Therefore, we believe that it can be a reliable solution for annotation cost reduction in medical image analysis.
引用
下载
收藏
页码:2015 / 2025
页数:11
相关论文
共 50 条
  • [1] Cross-domain image description generation using transfer learning
    Kinghorn, Philip
    Zhang, Li
    DATA SCIENCE AND KNOWLEDGE ENGINEERING FOR SENSING DECISION SUPPORT, 2018, 11 : 1462 - 1469
  • [2] Cross-domain Web Image Annotation
    Si, Si
    Tao, Dacheng
    Chan, Kwok-Ping
    2009 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2009), 2009, : 184 - +
  • [3] Social image annotation via cross-domain subspace learning
    Si Si
    Dacheng Tao
    Meng Wang
    Kwok-Ping Chan
    Multimedia Tools and Applications, 2012, 56 : 91 - 108
  • [4] Social image annotation via cross-domain subspace learning
    Si, Si
    Tao, Dacheng
    Wang, Meng
    Chan, Kwok-Ping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2012, 56 (01) : 91 - 108
  • [5] Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning
    Matias, Pedro
    Folgado, Duarte
    Gamboa, Hugo
    Carreiro, Andre
    ELECTRONICS, 2021, 10 (15)
  • [6] Dyadic Transfer Learning for Cross-Domain Image Classification
    Wang, Hua
    Nie, Feiping
    Huang, Heng
    Ding, Chris
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 551 - 556
  • [7] An iterative transfer learning framework for cross-domain tongue segmentation
    Li, Lei
    Luo, Zhiming
    Zhang, Mengting
    Cai, Yuanzheng
    Li, Candong
    Li, Shaozi
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (14):
  • [8] Image annotation by semi-supervised cross-domain learning with group sparsity
    Yuan, Ying
    Wu, Fei
    Shao, Jian
    Zhuang, Yueting
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2013, 24 (02) : 95 - 102
  • [9] Personalized image annotation via class-specific cross-domain learning
    Qian, Zhiming
    Zhong, Ping
    Wang, Runsheng
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2015, 34 : 61 - 71
  • [10] Deep Transfer Learning for Biology Cross-Domain Image Classification
    Guo, Chunfeng
    Wei, Bin
    Yu, Kun
    JOURNAL OF CONTROL SCIENCE AND ENGINEERING, 2021, 2021