Anomaly detection in hydrological network time series via multiresolution analysis

被引:0
|
作者
Pimentel Filho, Jorge A. [1 ]
Neves, Claudio F. [2 ]
Lopes, Walszon T. A. [1 ]
Carvalho, Joao Carlos [1 ]
机构
[1] Agencia Nacl Aguas & Saneamento Basico, Setor Policial, Area 5,Quadra 3,Bloco S-N, BR-70610200 Brasilia, DF, Brazil
[2] Univ Fed Rio de Janeiro, Ave Athos da Silveira Ramos,149 Cidade Univ Univ F, BR-21941909 Rio De Janeiro, RJ, Brazil
关键词
Anomaly detection; Sao Francisco River; Wavelet coherence; Outliers; LSTM; RAINFALL-RUNOFF RELATIONS; WAVELET COHERENCE; KARSTIC SPRINGS;
D O I
10.1016/j.jhydrol.2024.131667
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The territorial extension of Brazil imposes logistic challenges on hydrologic monitoring and increases the chances of systematic observational errors, gauge displacements, downsampling during observation, and low density of streamflow samples on high water stage. Consequently, time series would exhibit artifacts such as gaps, highfrequency anomalies, inhomogeneity, and trends. An innovative anomaly detection system based on multiresolution analysis (MADE) was developed and used to detect synthetic anomalies in raw water stage time series. MADE uses both time and frequency as contextual attributes to identify anomalies. The balance between temporal and frequency resolution allows for capturing low-frequency coarse information and high-frequency details. On MADE, Generalized Extreme Studentized Deviate (GESD) detected short time anomalies on water stage wavelet faster modes (2-, 4-, and 8-days periods). For periods greater than 16 days, Wavelet Coherence and Multiple Wavelet Coherence detected similar water stage time series anomalies. MADE outperformed a Long Short-Term Memory model, a time regression neural network k-Nearest Neighbor model and an Empirical Data Analytics model coupled with clustering techniques on detecting both fast and slow time-scales synthetic anomalies introduced in a Sao Francisco River water stage time series, using time and frequency domain to pursuit point, collective and contextual anomalies.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Time Series Anomaly Detection with Multiresolution Ensemble Decoding
    Shen, Lifeng
    Yu, Zhongzhong
    Ma, Qianli
    Kwok, James T.
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9567 - 9575
  • [2] Efficient time series anomaly detection by multiresolution self-supervised discriminative network
    Huang, Desen
    Shen, Lifeng
    Yu, Zhongzhong
    Zheng, Zhenjing
    Huang, Min
    Ma, Qianli
    [J]. NEUROCOMPUTING, 2022, 491 : 261 - 272
  • [3] Network anomaly detection using time series analysis
    Wu, QT
    Shao, ZQ
    [J]. 2005 JOINT INTERNATIONAL CONFERENCE ON AUTONOMIC AND AUTONOMOUS SYSTEMS AND INTERNATIONAL CONFERENCE ON NETWORKING AND SERVICES (ICAS/ICNS), 2005, : 259 - 264
  • [4] ECG anomaly detection via time series analysis
    Chuah, Mooi Choo
    Fu, Fen
    [J]. FRONTIERS OF HIGH PERFORMANCE COMPUTING AND NETWORKING - ISPA 2007 WORKSHOPS, 2007, 4743 : 123 - +
  • [5] Improving iForest for Hydrological Time Series Anomaly Detection
    Shao, Pengpeng
    Ye, Feng
    Liu, Zihao
    Wang, Xiwen
    Lu, Ming
    Mao, Yupeng
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2020, PT III, 2020, 12454 : 170 - 183
  • [6] Research on Anomaly Pattern Detection in Hydrological Time Series
    Sun, Jianshu
    Lou, Yuansheng
    Ye, Feng
    [J]. 2017 14TH WEB INFORMATION SYSTEMS AND APPLICATIONS CONFERENCE (WISA 2017), 2017, : 38 - 43
  • [7] Multivariate Time-series Anomaly Detection via Graph Attention Network
    Zhao, Hang
    Wang, Yujing
    Duan, Juanyong
    Huang, Congrui
    Cao, Defu
    Tong, Yunhai
    Xu, Bixiong
    Bai, Jing
    Tong, Jie
    Zhang, Qi
    [J]. 20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020), 2020, : 841 - 850
  • [8] Network Anomaly Detection Based on Statistical Approach and Time Series Analysis
    Huang Kai
    Qi Zhengwei
    Liu Bo
    [J]. 2009 INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS WORKSHOPS: WAINA, VOLS 1 AND 2, 2009, : 205 - 211
  • [9] Anomaly Detection in MODIS Land Products via Time Series Analysis
    Zhang Jingxiong
    Roy, David
    Devadiga, Sadashiva
    Min, Zheng
    [J]. GEO-SPATIAL INFORMATION SCIENCE, 2007, 10 (01) : 44 - 50
  • [10] Anomaly Detection in MODIS Land Products via Time Series Analysis
    David Roy
    Sadashiva Devadiga
    [J]. Geo-spatial Information Science, 2007, (01) : 44 - 50