Swin transformer network leveraging multi-dimensional features for defect depth prediction

被引:0
|
作者
Zhang, Siyan [1 ]
Omer, Akam M. [1 ]
Tao, Ning [2 ]
Sfarra, Stefano [3 ]
Zhang, Hai [4 ]
Maldague, Xavier [5 ]
Zhang, Cunlin [2 ]
Meng, Jianqiao [1 ]
Duan, Yuxia [1 ]
机构
[1] Cent South Univ, Sch Phys & Elect, 932 South Lushan Rd, Changsha 410083, Hunan, Peoples R China
[2] Capital Normal Univ, Key Lab Terahenz Optoelect, Minist Educ, Dept Phys, 105 West 3 Ring Rd North, Beijing 100048, Peoples R China
[3] Univ Aquila, Dept Ind & Informat Engn & Econ, I-67100 Laquila, Italy
[4] Harbin Inst Technol, Ctr Composite Mat & Struct, Harbin 150001, Peoples R China
[5] Laval Univ, Dept Elect & Comp Engn, Comp Vis & Syst Lab CVSL, Quebec City, PQ G1V 0A6, Canada
基金
中国国家自然科学基金;
关键词
Infrared thermography; Depth prediction; Multi -dimensional features; Hilbert encoding; Swin transformer; PULSED THERMOGRAPHY;
D O I
10.1016/j.infrared.2024.105288
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
This study introduces a novel method for accurately predicting defect depth in pulsed infrared thermography. The core innovation of this study lies in the utilization of multi-dimensional features to enhance the accuracy of depth prediction. By integrating temperature, temperature change rate, and time-frequency spectrum into a comprehensive feature set, we aim to capture a more detailed understanding of defect characteristics, thereby facilitating more precise predictions. Additionally, we employ the Hilbert encoding method to obtain twodimensional matrices and utilize mask-based augmentation to generate synthetic defect data matrices. Subsequently, the generated matrices are fed input into a Swin transformer network configured with shifted windows and multi-head self-attention. In comparison to existing high-performing architectures, our method leveraging multi-dimensional features, demonstrates superior performance, especially in defect depth prediction for nonplanar samples. This work paves the way for more accurate and efficient defect depth prediction in various infrared thermography applications.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Swin Transformer Combined with Convolution Neural Network for Surface Defect Detection
    Li, Yinghao
    Xiang, Yihao
    Guo, Haogong
    Liu, Panpan
    Liu, Chengming
    [J]. MACHINES, 2022, 10 (11)
  • [2] Prediction method of electricity stealing behavior based on multi-dimensional features and BP neural network
    Shang Ying
    Kang Liyan
    Zhang Muxin
    Liu Xinran
    Li Yunze
    [J]. ENERGY REPORTS, 2022, 8 : 523 - 531
  • [3] TINet: Multi-dimensional Traffic Data Imputation via Transformer Network
    Song, Xiaozhuang
    Ye, Yongchao
    Yu, James J. Q.
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT I, 2021, 12891 : 306 - 317
  • [4] A Multi-dimensional Coordinate Factorization Algorithm for Network Distance Prediction
    Chen, Shanxiong
    Li, Ya
    Pen, Maoling
    Zhang, Rui
    [J]. INFORMATION AND AUTOMATION, 2011, 86 : 32 - +
  • [5] Multi-scale, multi-dimensional binocular endoscopic image depth estimation network
    Wang, Xiongzhi
    Nie, Yunfeng
    Ren, Wenqi
    Wei, Min
    Zhang, Jingang
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 164
  • [6] Swin-Net: A Swin-Transformer-Based Network Combing with Multi-Scale Features for Segmentation of Breast Tumor Ultrasound Images
    Zhu, Chengzhang
    Chai, Xian
    Xiao, Yalong
    Liu, Xu
    Zhang, Renmao
    Yang, Zhangzheng
    Wang, Zhiyuan
    [J]. DIAGNOSTICS, 2024, 14 (03)
  • [7] Depressformer: Leveraging Video Swin Transformer and fine-grained local features for depression scale estimation
    He, Lang
    Li, Zheng
    Tiwari, Prayag
    Cao, Cui
    Xue, Jize
    Zhu, Feng
    Wu, Di
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [8] Multi-Dimensional Prediction of Respiration Motion
    Pitcher, G.
    Seibert, R.
    Ramsey, C.
    [J]. MEDICAL PHYSICS, 2008, 35 (06)
  • [9] NeuralNCD: A Neural Network Cognitive Diagnosis Model Based on Multi-Dimensional Features
    Li, Guangquan
    Hu, Yuqing
    Shuai, Junkai
    Yang, Tonghua
    Zhang, Yonghong
    Dai, Shiming
    Xiong, Naixue
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [10] Community Detection in Multi-dimensional Network
    Chen, Xiaolin
    Han, Guohui
    Yuan, Lin
    Huang, Qiang
    [J]. 2015 8TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2015, : 598 - 601