FedLGAN: a method for anomaly detection and repair of hydrological telemetry data based on federated learning

被引:1
|
作者
Chen, Zheliang [1 ]
Ni, Xianhan [1 ]
Li, Huan [2 ]
Kong, Xiangjie [2 ]
机构
[1] Zhejiang Prov Hydrol Management Ctr, Hangzhou, Zhejiang, Peoples R China
[2] Zhejiang Univ Technol, Coll Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Ubiquitous Computing; Things Federated learning; Anomaly detection; Data repair; Generative adversarial network; Long short-term memory networks;
D O I
10.7717/peerj-cs.1664
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The existing data repair methods primarily focus on addressing missing data issues by utilizing variational autoencoders to learn the underlying distribution and generate content that represents the missing parts, thus achieving data repair. However, this method is only applicable to data missing problems and cannot identify abnormal data. Additionally, as data privacy concerns continue to gain public attention, it poses a challenge to traditional methods. This article proposes a generative adversarial network (GAN) model based on the federated learning framework and a long shortterm memory network, namely the FedLGAN model, to achieve anomaly detection and repair of hydrological telemetry data. In this model, the discriminator in the GAN structure is employed for anomaly detection, while the generator is utilized for abnormal data repair. Furthermore, to capture the temporal features of the original data, a bidirectional long short-term memory network with an attention mechanism is embedded into the GAN. The federated learning framework avoids privacy leakage of hydrological telemetry data during the training process. Experimental results based on four real hydrological telemetry devices demonstrate that the FedLGAN model can achieve anomaly detection and repair while preserving privacy.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Harnessing federated learning for anomaly detection in supercomputer nodes
    Farooq, Emmen
    Milano, Michela
    Borghesi, Andrea
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 161 : 673 - 685
  • [42] Federated deep learning for anomaly detection in the internet of things
    Wang, Xiaofeng
    Wang, Yonghong
    Javaheri, Zahra
    Almutairi, Laila
    Moghadamnejad, Navid
    Younes, Osama S.
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 108
  • [43] Enhancing IoT anomaly detection performance for federated learning
    Brett Weinger
    Jinoh Kim
    Alex Sim
    Makiya Nakashima
    Nour Moustafa
    KJohn Wu
    Digital Communications and Networks, 2022, 8 (03) : 314 - 323
  • [44] Data relative currency repair and anomaly detection based on rules
    Duan, Xuliang
    Xiao, Zeyan
    Liu, Yuhai
    Li, Zhiyao
    Zhu, Qingsong
    Lang, Songsong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 243
  • [45] AREP: an adaptive, machine learning-based algorithm for real-time anomaly detection on network telemetry data
    Karoly Farkas
    Neural Computing and Applications, 2023, 35 : 6079 - 6094
  • [46] AREP: an adaptive, machine learning-based algorithm for real-time anomaly detection on network telemetry data
    Farkas, Karoly
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (08): : 6079 - 6094
  • [47] Anomaly Traffic Detection with Federated Learning toward Network-based Malware Detection in IoT
    Nishio, Takayuki
    Nakahara, Masataka
    Okui, Norihiro
    Kubota, Ayumu
    Kobayashi, Yasuaki
    Sugiyama, Keizo
    Shinkuma, Ryoichi
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 299 - 304
  • [48] Contrastive Learning with Prototype-Based Negative Mixing for Satellite Telemetry Anomaly Detection
    Guo, Guohang
    Hu, Tai
    Zhou, Taichun
    Li, Hu
    Liu, Yurong
    SENSORS, 2023, 23 (10)
  • [49] Anomaly Detection in Health Data Based on Deep Learning
    Han, Ning
    Gao, Sheng
    Li, Jin
    Zhang, Xinming
    Guo, Jun
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT (IEEE IC-NIDC), 2018, : 188 - 192
  • [50] Anomaly Detection Method for Operation and Maintenance Data Based on One-Class Learning
    Duan, Junhong
    Yang, Bo
    Wei, Xiang
    Liu, Ning
    Zhang, Yintie
    2019 5TH INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND MATERIAL APPLICATION, 2020, 440