Research on Monitoring Data Anomaly Recognition Algorithm Based on Time Series Compression and Segmentation

被引:0
|
作者
Pu, Qianhui [1 ]
Zhang, Ziyi [1 ]
Xiao, Tugang [1 ]
Hong, Yu [1 ]
Wen, Xuguang [2 ,3 ]
机构
[1] School of Civil Engineering, Southwest Jiaotong University, Chengdu,610031, China
[2] Guangxi Key Lahoratory of International Join for China-ASEAN Comprehensive Transportation, NanNing University, Nanning,530200, China
[3] NanNing University, Nanning,530200, China
关键词
Anomaly detection - Bridge cables - Highway bridges - Image segmentation - Interpolation - Linear regression - Network security - Time series;
D O I
10.20051/j.issn.1003-4722.2024.03.003
中图分类号
学科分类号
摘要
To cffccüvcly idcnüfy anomalics in bridge monitoring data and reduce the occurrence of falsc and missed alarms, and ensure thc quality and cffectiveness of bridge monitoring data as well, a monitoring data anomaly recognition algorithm based on time series compression and segmentation is proposed, counting on the anomalies (missing, outlier, and drifting)in the long-term monitoring data of long-span cable-stayed bridges. In this algorithm, the original monitoring data time series is segmented into multiple shorter time series using thc pieeewise linear regression with spectral information preservation algorithm based on important points(PLRSIP). Then, the similarity analysis of time series is performed using Euclidean distance, and the local outlier factor(LOF) algorithm is used to calculate the local outlier factor of cach time series. Finally, thc anomalies in the monitoring data are identified by comparing them with the set thresholds. The proposed algorithm has been applied to detect anomalies in the health monitoring data of an existing long-span highway bridge for verification. It is shown that the time sub-series can accurately reflect the trend and ränge of original series by using PLR _ SIP algorithm to compress and segment thc original ümc scrics. The improved LOF algorithm breaks through the limitations of thc traditional LOF algorithm which can only recognize outlicrs without duration. 1t can eliminate the interference of noise and realize the recognition of outliers, missing data and data drifting. The algorithm directly takes the original monitoring data as the input of the algorithm, with no need of defining the training sets, and can adaptively adjust the threshold Parameters. With sound scalability, real-time Performance, aecuraey, and efficiency, thc algorithm is capablc of processing real-time and mass bridge health monitoring data. © 2024 Wuhan Bridge Media Co., Ltd., MBEC. All rights reserved.
引用
收藏
页码:15 / 23
相关论文
共 50 条
  • [1] Trajectory Time Series Compression Algorithm Based on Unsupervised Segmentation
    Shuang SUN
    Yan CHEN
    Zaiji PIAO
    JournalofSystemsScienceandInformation, 2024, 12 (03) : 360 - 378
  • [2] The Financial Data of Anomaly Detection Research based on Time Series
    Guo, Chen-Ming
    Xu, Ling-Yu
    Liu, Hui-Fang
    Wang, Lei
    Yu, Xiang
    Han, Bo
    2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATIONS (CSA), 2015, : 86 - 89
  • [3] YASA: Yet Another Time Series Segmentation Algorithm for Anomaly Detection in Big Data Problems
    Marti, Luis
    Sanchez-Pi, Nayat
    Manuel Molina, Jose
    Bicharra Garcia, Ana Cristina
    HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, HAIS 2014, 2014, 8480 : 697 - 708
  • [4] Text data compression and storage algorithm based on time series model
    Weng Y.-H.
    Li N.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (07): : 2109 - 2114
  • [5] Anomaly Series Detection Algorithm Based on Segmentation Feature Representation
    Song, Chunlei
    Zhao, Xujun
    Gao, Yaxing
    Jin, Guangyin
    Computer Engineering and Applications, 2023, 59 (09) : 262 - 271
  • [6] Research of Anomaly Detection Based on Time Series
    Wang, Guilan
    Wang, Zhenqi
    Luo, Xianjin
    2009 WRI WORLD CONGRESS ON SOFTWARE ENGINEERING, VOL 1, PROCEEDINGS, 2009, : 444 - 448
  • [7] Design of communication data classification algorithm based on fuzzy segmentation of time series
    Zhang Y.-F.
    Chen T.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (11): : 3268 - 3273
  • [8] Compression algorithm of road traffic data in time series based on temporal correlation
    Wang, Yong-dong
    Xu, Dong-wei
    Lu, Yun
    Shen, Jun-Yan
    Zhang, Gui-jun
    IET INTELLIGENT TRANSPORT SYSTEMS, 2018, 12 (03) : 177 - 185
  • [9] Cocv: A compression algorithm for time-series data with continuous constant values in IoT-based monitoring systems
    Lin, Shengsheng
    Lin, Weiwei
    Wu, Keyi
    Wang, Songbo
    Xu, Minxian
    Wang, James Z.
    INTERNET OF THINGS, 2024, 25
  • [10] Research on Anomaly Monitoring Algorithm of Uncertain Large Data Flow Based on Artificial Intelligence
    Jia, Shuang-cheng
    Yang, Feng-ping
    ADVANCED HYBRID INFORMATION PROCESSING, ADHIP 2019, PT II, 2019, 302 : 109 - 117