Combining Synthetic Images and Deep Active Learning: Data-Efficient Training of an Industrial Object Detection Model

被引:0
|
作者
Eversberg, Leon [1 ]
Lambrecht, Jens [1 ]
Wang, Guanghui
机构
[1] Tech Univ Berlin, Fac Electr Engn & Comp Sci 4, Ind Grade Networks & Clouds, Str 17 Juni 135, D-10623 Berlin, Germany
关键词
active learning; computer vision; data efficiency; deep active learning; deep learning; image synthesis; industrial application; object detection; synthetic images; turbine blade;
D O I
10.3390/jimaging10010016
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Generating synthetic data is a promising solution to the challenge of limited training data for industrial deep learning applications. However, training on synthetic data and testing on real-world data creates a sim-to-real domain gap. Research has shown that the combination of synthetic and real images leads to better results than those that are generated using only one source of data. In this work, the generation of synthetic training images via physics-based rendering is combined with deep active learning for an industrial object detection task to iteratively improve model performance over time. Our experimental results show that synthetic images improve model performance, especially at the beginning of the model's life cycle with limited training data. Furthermore, our implemented hybrid query strategy selects diverse and informative new training images in each active learning cycle, which outperforms random sampling. In conclusion, this work presents a workflow to train and iteratively improve object detection models with a small number of real-world images, leading to data-efficient and cost-effective computer vision models.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] A fast and data-efficient deep learning framework for multi-class fruit blossom detection
    Zhou, Wei
    Cui, Yifan
    Huang, Hongpu
    Huang, Haitian
    Wang, Chen
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 217
  • [32] Synthetic Training Data Generation for Fault Detection Based on Deep Learning
    Choi, Woochang
    Pyun, Sukjoon
    [J]. GEOPHYSICS AND GEOPHYSICAL EXPLORATION, 2021, 24 (03): : 89 - 97
  • [33] Training with synthetic images for object detection and segmentation in real machinery images
    Salas, Alonso J. Cerpa
    Meza-Lovon, Graciela
    Fernandez, Manuel E. Loaiza
    Raposo, Alberto
    [J]. 2020 33RD SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2020), 2020, : 226 - 233
  • [34] Data-Efficient, Federated Learning for Raw Network Traffic Detection
    Willeke, Mikal R.
    Bierbrauer, David A.
    Bastian, Nathaniel D.
    [J]. ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS V, 2023, 12538
  • [35] DeMis: Data-Efficient Misinformation Detection Using Reinforcement Learning
    Kawintiranon, Kornraphop
    Singh, Lisa
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II, 2023, 13714 : 224 - 240
  • [36] EFFICIENT YOLO: A LIGHTWEIGHT MODEL FOR EMBEDDED DEEP LEARNING OBJECT DETECTION
    Wang, Zixuan
    Zhang, Jiacheng
    Zhao, Zhicheng
    Su, Fei
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [37] Data-Efficient Graph Embedding Learning for PCB Component Detection
    Kuo, Chia-Wen
    Ashmore, Jacob D.
    Huggins, David
    Kira, Zsolt
    [J]. 2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 551 - 560
  • [38] A data-efficient self-supervised deep learning model for design and characterization of nanophotonic structures
    Ma, Wei
    Liu, Yongmin
    [J]. SCIENCE CHINA-PHYSICS MECHANICS & ASTRONOMY, 2020, 63 (08):
  • [39] Deep Active Learning for Efficient Training of a LiDAR 3D Object Detector
    Feng, Di
    Wei, Xiao
    Rosenbaum, Lars
    Maki, Atsuto
    Dietmayer, Klaus
    [J]. 2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 667 - 674
  • [40] A data-efficient self-supervised deep learning model for design and characterization of nanophotonic structures
    Wei Ma
    Yongmin Liu
    [J]. Science China Physics, Mechanics & Astronomy, 2020, 63