Geo-Hgan: Unsupervised anomaly detection in geochemical data via latent space learning

被引:0
|
作者
Ding, Liang [1 ]
Chen, Bainian [1 ]
Zhu, Yuelong [1 ]
Dong, Hai [2 ]
Chan, Guiyang [1 ]
Zhang, Pengcheng [1 ]
机构
[1] Hohai Univ, Coll Comp Sci & Software Engn, Nanjing, Peoples R China
[2] RMIT Univ, Sch Comp Technol, Melbourne, Australia
关键词
Geochemical data; Generative adversarial networks; Anomaly detection; Transfer learning; BIG DATA ANALYTICS; MINERAL PROSPECTIVITY; ROC;
D O I
10.1016/j.cageo.2024.105703
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing geochemical data for anomaly detection using Generative Adversarial Networks (GANs) has become a prevalent method in identifying geochemical anomalies. However, injecting random noise into GANs can induce model instability. To mitigate this issue, we propose a novel anomaly detection model, Geo-Hgan, which integrates a dual adversarial network architecture with a Latent Space Adversarial Module (LSAM) to learn the distribution of latent variables from arbitrary data and optimize the sample reconstruction process, thereby alleviating instability during GAN training. Additionally, an encoder guided by the LSAM-pretrained GAN is employed to extract variational features, facilitating rapid and effective sample mapping into the latent space defined by LSAM. Experimental results demonstrate that under unsupervised conditions, Geo-Hgan achieves an Area Under the Curve (AUC) score of 85% across three geochemical datasets, outperforming similar models in accuracy and reconstruction capabilities. To assess its versatility and generalization ability, we extend Geo-Hgan to anomaly detection tasks in computer vision, where it achieves an average AUC score of 98.7% on the MvtecAD dataset, setting a new state-of-the-art performance in the domain. Furthermore, we propose AnomFilter, a method for setting anomaly thresholds based on the clustering hypothesis. AnomFilter identifies high-confidence anomaly samples identified by Geo-Hgan in the source domain and iteratively transfers them to the target domain. These high-confidence anomaly samples, combined with a small number of known positive samples in the target domain, enhance the accuracy of supervised geochemical anomaly detection in the target domain, which achieved an AUC score of 94%. The utilization of anomaly detection models for sample transfer learning offers a novel perspective for future work.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Unsupervised Learning for Anomaly Detection of Electric Motors
    Son, Jonghwan
    Kim, Chayoung
    Jeong, Minjoong
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2022, 23 (04) : 421 - 427
  • [32] Unsupervised LSTMs-based Learning for Anomaly Detection in Highway Traffic Data
    Di Mauro, Nicola
    Ferilli, Stefano
    FOUNDATIONS OF INTELLIGENT SYSTEMS (ISMIS 2018), 2018, 11177 : 281 - 290
  • [33] An Unsupervised Deep Learning Framework for Anomaly Detection
    Kuo, Che-Wei
    Ying, Josh Jia-Ching
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2023, PT I, 2023, 13995 : 284 - 295
  • [34] Unsupervised Network Anomaly Detection by Learning on 2D Data Representations
    Casarin, Sofia
    Baldoni, Sara
    Carli, Marco
    Zanuttigh, Pietro
    Battisti, Federica
    2022 9TH SWISS CONFERENCE ON DATA SCIENCE (SDS), 2022, : 53 - 58
  • [35] Learning Representations from Healthcare Time Series Data for Unsupervised Anomaly Detection
    Pereira, Joao
    Silveira, Margarida
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2019, : 84 - 90
  • [36] Comparative Analysis of Unsupervised Machine Learning Algorithms for Anomaly Detection in Network Data
    Oliveira, Junia Maisa
    Almeida, Jonatan
    Macedo, Daniel
    Nogueira, Jose Marcos
    2023 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS, LATINCOM, 2023,
  • [37] Fast Adaption for Multi Motor Anomaly Detection via Meta Learning and deep unsupervised learning
    Yu, Yi-Cheng
    Chuang, Shang-Wen
    Shuai, Hong-Han
    Lee, Chen-Yi
    2022 IEEE 31ST INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2022, : 1186 - 1189
  • [38] Unsupervised Anomaly Detection in Sequential Process Data
    Bulut, Okan
    Gorgun, Guher
    He, Surina
    ZEITSCHRIFT FUR PSYCHOLOGIE-JOURNAL OF PSYCHOLOGY, 2024, 232 (02): : 74 - 94
  • [39] Unsupervised Anomaly Detection in Data Quality Control
    Poon, Lex
    Farshidi, Siamak
    Li, Na
    Zhao, Zhiming
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 2327 - 2336
  • [40] Unsupervised Anomaly Detection on Temporal Multiway Data
    Duc Nguyen
    Phuoc Nguyen
    Kien Do
    Rana, Santu
    Gupta, Sunil
    Truyen Tran
    2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 1059 - 1066