Combining Synthetic Images and Deep Active Learning: Data-Efficient Training of an Industrial Object Detection Model

被引:0
|
作者
Eversberg, Leon [1 ]
Lambrecht, Jens [1 ]
Wang, Guanghui
机构
[1] Tech Univ Berlin, Fac Electr Engn & Comp Sci 4, Ind Grade Networks & Clouds, Str 17 Juni 135, D-10623 Berlin, Germany
关键词
active learning; computer vision; data efficiency; deep active learning; deep learning; image synthesis; industrial application; object detection; synthetic images; turbine blade;
D O I
10.3390/jimaging10010016
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Generating synthetic data is a promising solution to the challenge of limited training data for industrial deep learning applications. However, training on synthetic data and testing on real-world data creates a sim-to-real domain gap. Research has shown that the combination of synthetic and real images leads to better results than those that are generated using only one source of data. In this work, the generation of synthetic training images via physics-based rendering is combined with deep active learning for an industrial object detection task to iteratively improve model performance over time. Our experimental results show that synthetic images improve model performance, especially at the beginning of the model's life cycle with limited training data. Furthermore, our implemented hybrid query strategy selects diverse and informative new training images in each active learning cycle, which outperforms random sampling. In conclusion, this work presents a workflow to train and iteratively improve object detection models with a small number of real-world images, leading to data-efficient and cost-effective computer vision models.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A Data-Efficient Training Method for Deep Reinforcement Learning
    Feng, Wenhui
    Han, Chongzhao
    Lian, Feng
    Liu, Xia
    [J]. ELECTRONICS, 2022, 11 (24)
  • [2] Biometric contrastive learning for data-efficient deep learning from electrocardiographic images
    Sangha, Veer
    Khunte, Akshay
    Holste, Gregory
    Mortazavi, Bobak J.
    Wang, Zhangyang
    Oikonomou, Evangelos K.
    Khera, Rohan
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2024, 31 (04) : 855 - 865
  • [3] BIOMETRIC CONTRASTIVE MODELING FOR DATA-EFFICIENT DEEP LEARNING FROM ELECTROCARDIOGRAPHIC IMAGES
    Sangha, Veer
    Khunte, Akshay
    Holste, Gregory
    Mortazavi, Bobak
    Wang, Zhangyang
    Oikonomou, Evangelos K.
    Khera, Rohan
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF CARDIOLOGY, 2023, 81 (08) : 2403 - 2403
  • [4] A self-supervised deep learning method for data-efficient training in genomics
    Hüseyin Anil Gündüz
    Martin Binder
    Xiao-Yin To
    René Mreches
    Bernd Bischl
    Alice C. McHardy
    Philipp C. Münch
    Mina Rezaei
    [J]. Communications Biology, 6
  • [5] A self-supervised deep learning method for data-efficient training in genomics
    Guenduez, Hueseyin Anil
    Binder, Martin
    To, Xiao-Yin
    Mreches, Rene
    Bischl, Bernd
    McHardy, Alice C.
    Muench, Philipp C.
    Rezaei, Mina
    [J]. COMMUNICATIONS BIOLOGY, 2023, 6 (01)
  • [6] Data-efficient deep reinforcement learning with expert demonstration for active flow control
    Zheng, Changdong
    Xie, Fangfang
    Ji, Tingwei
    Zhang, Xinshuai
    Lu, Yufeng
    Zhou, Hongjie
    Zheng, Yao
    [J]. PHYSICS OF FLUIDS, 2022, 34 (11)
  • [7] Deep learning exoplanets detection by combining real and synthetic data
    Cuellar, Sara
    Granados, Paulo
    Fabregas, Ernesto
    Cure, Michel
    Vargas, Hector
    Dormido-Canto, Sebastian
    Farias, Gonzalo
    [J]. PLOS ONE, 2022, 17 (05):
  • [8] A Data-Efficient Deep Learning Method for Rough Surface Clutter Reduction in GPR Images
    Zhang, Yan
    Diao, Enmao
    Huston, Dryver
    Xia, Tian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [9] A Data-Efficient Training Model for Signal Integrity Analysis based on Transfer Learning
    Zhang, Tingrui
    Chen, Siyu
    Wei, Shuwu
    Chen, Jienan
    [J]. 2019 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2019), 2019, : 182 - 185
  • [10] Self-Tuning for Data-Efficient Deep Learning
    Wang, Ximei
    Gao, Jinghan
    Long, Mingsheng
    Wang, Jianmin
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139 : 7748 - 7759