Unsupervised Pre-Training of Imbalanced Data for Identification of Wafer Map Defect Patterns

被引:13
|
作者
Shon, Ho Sun [1 ]
Batbaatar, Erdenebileg [2 ]
Cho, Wan-Sup [3 ]
Choi, Seong Gon [4 ]
机构
[1] Chungbuk Natl Univ, Res Inst Comp & Informat Commun, Cheongju 28644, South Korea
[2] Chungbuk Natl Univ, Sch Elect Comp Engn, Cheongju 28644, South Korea
[3] Chungbuk Natl Univ, Dept Management Informat Syst, Cheongju 28644, South Korea
[4] Chungbuk Natl Univ, Sch Informat & Commun Engn, Cheongju 28644, South Korea
基金
新加坡国家研究基金会;
关键词
Feature extraction; Fabrication; Semiconductor device modeling; Deep learning; Visualization; Convolutional codes; Training; Classification; convolutional variational autoencoder; deep learning; imbalanced data; neural network; unsupervised pre-training; variational autoencoder; wafer map defect patterns; CONVOLUTIONAL NEURAL-NETWORK; NEAREST-NEIGHBOR RULE; SEMICONDUCTOR; CLASSIFICATION; RECOGNITION; MACHINE; MODEL; MANAGEMENT; DIAGNOSIS;
D O I
10.1109/ACCESS.2021.3068378
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual defect inspection and classification are significant steps of most manufacturing processes in the semiconductor and electronics industries. Known and unknown defects on wafer maps tend to cluster, and these spatial patterns provide valuable process information for supporting manufacturing in determining the root causes of abnormal processes. In previous studies, data augmentation-based deep learning (DL) techniques were most commonly used for the identification of wafer map defect patterns (WMDP). Data augmentation is an effective technique for improving the accuracy of modern image classifiers. However, current data augmentation implementations were manually designed for the WMDP problem. In this study, we propose a DL-based method with automatic data augmentation for the WMDP task. Basically, it focuses on learning effective discriminative features, from wafer maps, through a deep network structure. The network consists of a convolution-based variational autoencoder (CVAE) sequentially. First, we pre-trained the CVAE on large training data in an unsupervised manner. Second, we fine-tuned the encoder of the CVAE, which was followed by a neural network (NN) classifier, in a supervised manner. Additionally, we describe a simple procedure for automatically searching for improved data augmentation policies. The policy mainly consists of five image processing functions: rotation, flipping, shifting, shearing range, and zooming. The effectiveness of the proposed method was demonstrated through experimental results obtained from a simulation dataset and a real-world wafer map dataset (WM-811K). This study provides guidance for the application of deep learning in semiconductor manufacturing processes to improve product quality and yield.
引用
收藏
页码:52352 / 52363
页数:12
相关论文
共 50 条
  • [1] Unsupervised Pre-training Classifier Based on Restricted Boltzmann Machine with Imbalanced Data
    Fu, Xiaoyang
    [J]. SMART COMPUTING AND COMMUNICATION, SMARTCOM 2016, 2017, 10135 : 102 - 110
  • [2] Unsupervised Pre-training for Person Re-identification
    Fu, Dengpan
    Chen, Dongdong
    Bao, Jianmin
    Yang, Hao
    Yuan, Lu
    Zhang, Lei
    Li, Houqiang
    Chen, Dong
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14745 - 14754
  • [3] Unsupervised Pre-Training for Detection Transformers
    Dai, Zhigang
    Cai, Bolun
    Lin, Yugeng
    Chen, Junying
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 12772 - 12782
  • [4] Unsupervised Pre-Training for Voice Activation
    Kolesau, Aliaksei
    Sesok, Dmitrij
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (23): : 1 - 13
  • [5] Unsupervised Pre-Training of Image Features on Non-Curated Data
    Caron, Mathilde
    Bojanowski, Piotr
    Mairal, Julien
    Joulin, Armand
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2959 - 2968
  • [6] Deeply Unsupervised Patch Re-Identification for Pre-Training Object Detectors
    Ding, Jian
    Xie, Enze
    Xu, Hang
    Jiang, Chenhan
    Li, Zhenguo
    Luo, Ping
    Xia, Gui-Song
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1348 - 1361
  • [7] An oversampling method for wafer map defect pattern classification considering small and imbalanced data
    Kim, Eun-Su
    Choi, Seung-Hyun
    Lee, Dong-Hee
    Kim, Kwang-Jae
    Bae, Young-Mok
    Oh, Young-Chan
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 162
  • [8] Robust and Reliable Feature Extractor Training by Using Unsupervised Pre-training with Self-Organization Map
    Lee, You-Min
    Kim, Jong-Hwan
    [J]. ROBOT INTELLIGENCE TECHNOLOGY ANDAPPLICATIONS 3, 2015, 345 : 159 - 170
  • [9] A Deep Learning Model for Identification of Defect Patterns in Semiconductor Wafer Map
    Yang Yuan-Fu
    [J]. 2019 30TH ANNUAL SEMI ADVANCED SEMICONDUCTOR MANUFACTURING CONFERENCE (ASMC), 2019,
  • [10] Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data
    Grundkiewicz, Roman
    Junczys-Dowmunt, Marcin
    Heafield, Kenneth
    [J]. INNOVATIVE USE OF NLP FOR BUILDING EDUCATIONAL APPLICATIONS, 2019, : 252 - 263