Symmetric contrastive learning for robust fault detection in time-series traffic sensor data

被引:0
|
作者
Huang, Yongcan [1 ]
Yang, Jidong J. [1 ]
机构
[1] Univ Georgia, Coll Engn, Smart Mobil & Infrastruct Lab, Athens, GA 30602 USA
关键词
Traffic sensor; Sensor fault detection; Symmetric contrastive learning; Anchor-centered sampling; Triplet network;
D O I
10.1007/s41060-024-00521-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traffic sensor data are prone to malfunctions caused by various factors such as manufacturing defects, harsh environmental conditions, improper installation, and maintenance. While fault data detection is a well-established practice in many engineering domains, its application for quality control of traffic sensor data has not received due attention. This paper introduces a symmetric contrastive learning approach that employs a triplet network with an efficient sampling strategy, coupled with a novel cross-attention-boosted loss function for network training. To better discern the faults observed in the time-series of traffic sensor data, we employ continuous wavelet transformation (CWT) as a preprocessing step to obtain time-frequency wavelet image representation. These CWT images are used to pretrain the triplet encoder. To enhance training efficiency, we adopt an anchor-centered sampling strategy, referred to as symmetric contrastive sampling. This involves sampling a normal day of time-series traffic data as the anchor and generating three positive and three negative examples based on the domain knowledge. The loss is computed from the nine anchor-centered possible permutations of the triplet (anchor, negative, positive). This symmetric sampling approach facilitates direct contrast between positive and negative examples derived from the same anchor, leading to stronger contrastive signals for faster and more stable learning process. In comparison with traditional triplet and Siamese networks, as well as a classic threshold-based method, our proposed approach shows superior performance in detecting faulty data sequences. The experimental results demonstrate an impressive accuracy of 97.6%, precision of 97.5%, recall of 97.7%, and an F1-score of 97.6%.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Industrial Fault Detection using Contrastive Representation Learning on Time-series Data
    Zhang, Kexin
    Cai, Rongyao
    Liu, Yong
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 3197 - 3202
  • [2] Debiased Contrastive Learning for Time-Series Representation Learning and Fault Detection
    Zhang, Kexin
    Cai, Rongyao
    Zhou, Chunlin
    Liu, Yong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (05) : 7641 - 7653
  • [3] Contrastive Explanations for a Deep Learning Model on Time-Series Data
    Labaien, Jokin
    Zugasti, Ekhi
    De Carlos, Xabier
    [J]. BIG DATA ANALYTICS AND KNOWLEDGE DISCOVERY (DAWAK 2020), 2020, 12393 : 235 - 244
  • [4] Contrastive Time-Series Anomaly Detection
    Kim, Hyungi
    Kim, Siwon
    Min, Seonwoo
    Lee, Byunghan
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (10) : 5053 - 5065
  • [5] Multiview Graph Contrastive Learning for Multivariate Time-Series Anomaly Detection in IoT
    Qin, Shuxin
    Chen, Lin
    Luo, Yongcan
    Tao, Gaofeng
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (24) : 22401 - 22414
  • [6] TiCTok: Time-Series Anomaly Detection With Contrastive Tokenization
    Kang, Minseo
    Lee, Byunghan
    [J]. IEEE ACCESS, 2023, 11 : 81011 - 81020
  • [7] AN INFLUENCE METHOD FOR OUTLIER DETECTION APPLIED TO TIME-SERIES TRAFFIC DATA
    WATSON, SM
    REDFERN, E
    CLARK, S
    TIGHT, M
    DAVIES, N
    [J]. JOURNAL OF APPLIED STATISTICS, 1995, 22 (01) : 135 - 149
  • [8] Unsupervised anomaly detection by densely contrastive learning for time series data
    Zhu, Wei
    Li, Weijian
    Dorsey, E. Ray
    Luo, Jiebo
    [J]. NEURAL NETWORKS, 2023, 168 : 450 - 458
  • [9] Detection and Classification of Fault Types in Distribution Lines by Applying Contrastive Learning to GAN Encoded Time-Series of Pulse Reflectometry Signals
    Granado Fornas, Javier
    Herrero Jaraba, Elias
    Llombart Estopinan, Andres
    Saldana, Jose
    [J]. IEEE ACCESS, 2022, 10 : 110521 - 110536
  • [10] Utilizing Expert Features for Contrastive Learning of Time-Series Representations
    Nonnenmacher, Manuel
    Oldenburg, Lukas
    Steinwart, Ingo
    Reeb, David
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,