Federated learning-based semantic segmentation for pixel-wise defect detection in additive manufacturing

被引:44
|
作者
Mehta, Manan [1 ]
Shao, Chenhui [1 ]
机构
[1] Univ Illinois, Dept Mech Sci & Engn, Urbana, IL 61801 USA
关键词
Quality; Defect detection; Federated learning; Semantic segmentation; Metal additive manufacturing; Data privacy; CHALLENGES; NETWORK;
D O I
10.1016/j.jmsy.2022.06.010
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Semantic segmentation is a promising machine learning (ML) method for highly precise fine-scale defect detection and part qualification in additive manufacturing (AM). Most existing segmentation methods utilize convolutional neural network architectures that require large quantities of training data. However, obtaining sufficient data-both in quality and quantity-to train such models is expensive and time-consuming for individual AM practitioners, which severely limits the deployment of semantic segmentation in a data-scarce production environment. Similar data may be readily available with other AM practitioners that cannot be pooled together for conventional centralized learning (CL) due to its sensitive nature or conflicts of interest. This paper develops a federated learning (FL)-based method to simultaneously alleviate the constraints of data availability and data privacy. A U-Net architecture is created for semantic segmentation and is trained under the FL framework. The effectiveness of the developed FL-based semantic segmentation approach is demonstrated using case studies on layer-wise images from the laser powder bed fusion process. Results show that the proposed technique achieves a comparable defect detection performance with CL, which shares data among manufacturers/clients but does not preserve data privacy, and significantly outperforms individual learning, where each manufacturer trains a model using its own data. Additionally, the impact of data distribution across clients, incentives to participate in FL, and the learning dynamics of FL are discussed in detail. It is found that data diversity within and across clients improves FL performance, and FL does not involve a significantly higher training cost compared to CL. Lastly, transfer learning is shown to enhance FL generalizability, thus allowing more manufacturers with heterogeneous machines or technologies to benefit from participating in a data federation. Overall, this work puts forth FL as a promising paradigm for privacy-preserving collaborative ML in AM process control.
引用
收藏
页码:197 / 210
页数:14
相关论文
共 50 条
  • [1] Contrastive learning-based semantic segmentation for In-situ stratified defect detection in additive manufacturing
    Wang, Kang
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2023, 68 : 465 - 476
  • [2] Residual Pattern Learning for Pixel-wise Out-of-Distribution Detection in Semantic Segmentation
    Liu, Yuyuan
    Ding, Choubo
    Tian, Yu
    Pang, Guansong
    Belagiannis, Vasileios
    Reid, Ian
    Carneiro, Gustavo
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1151 - 1161
  • [3] Civil infrastructure defect assessment using pixel-wise segmentation based on deep learning
    Savino, Pierclaudio
    Tondolo, Francesco
    [J]. JOURNAL OF CIVIL STRUCTURAL HEALTH MONITORING, 2023, 13 (01) : 35 - 48
  • [4] Deep learning-based image segmentation for defect detection in additive manufacturing: an overview
    Deshpande, Sourabh
    Venugopal, Vysakh
    Kumar, Manish
    Anand, Sam
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 134 (5-6): : 2081 - 2105
  • [5] Civil infrastructure defect assessment using pixel-wise segmentation based on deep learning
    Pierclaudio Savino
    Francesco Tondolo
    [J]. Journal of Civil Structural Health Monitoring, 2023, 13 : 35 - 48
  • [6] PIXEL-WISE FAILURE PREDICTION FOR SEMANTIC VIDEO SEGMENTATION
    Kuhn, Christopher B.
    Hofbauer, Markus
    Xu, Ziqin
    Petrovic, Goran
    Steinbach, Eckehard
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 614 - 618
  • [7] Deep Learning-Based Pixel-Wise Lesion Segmentation on Oral Squamous Cell Carcinoma Images
    Martino, Francesco
    Bloisi, Domenico D.
    Pennisi, Andrea
    Fawakherji, Mulham
    Ilardi, Gennaro
    Russo, Daniela
    Nardi, Daniele
    Staibano, Stefania
    Merolla, Francesco
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (22): : 1 - 14
  • [8] Semantic Segmentation of Tree-Canopy in Urban Environment with Pixel-Wise Deep Learning
    Martins, Jose Augusto Correa
    Nogueira, Keiller
    Osco, Lucas Prado
    Gomes, Felipe David Georges
    Furuya, Danielle Elis Garcia
    Goncalves, Wesley Nunes
    Sant'Ana, Diego Andre
    Ramos, Ana Paula Marques
    Liesenberg, Veraldo
    dos Santos, Jefersson Alex
    de Oliveira, Paulo Tarso Sanches
    Marcato Junior, Jose
    [J]. REMOTE SENSING, 2021, 13 (16)
  • [9] Feature Augmentation Based on Pixel-Wise Attention for Rail Defect Detection
    Li, Hongjue
    Li, Hailang
    Hou, Zhixiong
    Song, Haoran
    Liu, Junbo
    Dai, Peng
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (16):
  • [10] Layer-wise anomaly detection and classification for powder bed additive manufacturing processes: A machine-agnostic algorithm for real-time pixel-wise semantic segmentation
    Scime, Luke
    Siddel, Derek
    Baird, Seth
    Paquit, Vincent
    [J]. ADDITIVE MANUFACTURING, 2020, 36