Geo-Hgan: Unsupervised anomaly detection in geochemical data via latent space learning

被引:0
|
作者
Ding, Liang [1 ]
Chen, Bainian [1 ]
Zhu, Yuelong [1 ]
Dong, Hai [2 ]
Chan, Guiyang [1 ]
Zhang, Pengcheng [1 ]
机构
[1] Hohai Univ, Coll Comp Sci & Software Engn, Nanjing, Peoples R China
[2] RMIT Univ, Sch Comp Technol, Melbourne, Australia
关键词
Geochemical data; Generative adversarial networks; Anomaly detection; Transfer learning; BIG DATA ANALYTICS; MINERAL PROSPECTIVITY; ROC;
D O I
10.1016/j.cageo.2024.105703
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing geochemical data for anomaly detection using Generative Adversarial Networks (GANs) has become a prevalent method in identifying geochemical anomalies. However, injecting random noise into GANs can induce model instability. To mitigate this issue, we propose a novel anomaly detection model, Geo-Hgan, which integrates a dual adversarial network architecture with a Latent Space Adversarial Module (LSAM) to learn the distribution of latent variables from arbitrary data and optimize the sample reconstruction process, thereby alleviating instability during GAN training. Additionally, an encoder guided by the LSAM-pretrained GAN is employed to extract variational features, facilitating rapid and effective sample mapping into the latent space defined by LSAM. Experimental results demonstrate that under unsupervised conditions, Geo-Hgan achieves an Area Under the Curve (AUC) score of 85% across three geochemical datasets, outperforming similar models in accuracy and reconstruction capabilities. To assess its versatility and generalization ability, we extend Geo-Hgan to anomaly detection tasks in computer vision, where it achieves an average AUC score of 98.7% on the MvtecAD dataset, setting a new state-of-the-art performance in the domain. Furthermore, we propose AnomFilter, a method for setting anomaly thresholds based on the clustering hypothesis. AnomFilter identifies high-confidence anomaly samples identified by Geo-Hgan in the source domain and iteratively transfers them to the target domain. These high-confidence anomaly samples, combined with a small number of known positive samples in the target domain, enhance the accuracy of supervised geochemical anomaly detection in the target domain, which achieved an AUC score of 94%. The utilization of anomaly detection models for sample transfer learning offers a novel perspective for future work.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Latent Space Embedding for Unsupervised Feature Selection via Joint Dictionary Learning
    Fan, Yang
    Dai, Jianhua
    Zhang, Qilai
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [22] Robust Tracking via Learning Model Update With Unsupervised Anomaly Detection Philosophy
    Gao, Jie
    Zhong, Bineng
    Chen, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2330 - 2341
  • [23] ANOMALY DETECTION IN HYPERSPECTRAL IMAGES VIA SUPERPIXEL SEGMENTATION AND UNSUPERVISED BACKGROUND LEARNING
    Arisoy, Sertac
    Kayabol, Koray
    2019 10TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING - EVOLUTION IN REMOTE SENSING (WHISPERS), 2019,
  • [24] Latent Space Correlation-Aware Autoencoder for Anomaly Detection in Skewed Data
    Roy, Padmaksha
    Singhal, Himanshu
    O'Shea, Timothy J.
    Jilt, Ming
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT I, PAKDD 2024, 2024, 14645 : 66 - 77
  • [25] Image Anomaly Detection Using Normal Data Only by Latent Space Resampling
    Wang, Lu
    Zhang, Dongkai
    Guo, Jiahao
    Han, Yuexing
    APPLIED SCIENCES-BASEL, 2020, 10 (23): : 1 - 19
  • [26] Manifold learning techniques for unsupervised anomaly detection
    Olson, C. C.
    Judd, K. P.
    Nichols, J. M.
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 91 : 374 - 385
  • [27] Anomaly Detection through Unsupervised Federated Learning
    Nardi, Mirko
    Valerio, Lorenzo
    Passarella, Andrea
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 495 - 501
  • [28] Unsupervised Learning for Anomaly Detection of Electric Motors
    Jonghwan Son
    Chayoung Kim
    Minjoong Jeong
    International Journal of Precision Engineering and Manufacturing, 2022, 23 : 421 - 427
  • [29] Unsupervised Adversarial Learning of Anomaly Detection in the Wild
    Berg, Amanda
    Felsberg, Michael
    Ahlberg, Jorgen
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1002 - 1008
  • [30] An unsupervised anomaly detection patterns learning algorithm
    Yang, YJ
    Ma, FY
    2003 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY, VOL 1 AND 2, PROCEEDINGS, 2003, : 400 - 402