Geo-Hgan: Unsupervised anomaly detection in geochemical data via latent space learning

被引:0
|
作者
Ding, Liang [1 ]
Chen, Bainian [1 ]
Zhu, Yuelong [1 ]
Dong, Hai [2 ]
Chan, Guiyang [1 ]
Zhang, Pengcheng [1 ]
机构
[1] Hohai Univ, Coll Comp Sci & Software Engn, Nanjing, Peoples R China
[2] RMIT Univ, Sch Comp Technol, Melbourne, Australia
关键词
Geochemical data; Generative adversarial networks; Anomaly detection; Transfer learning; BIG DATA ANALYTICS; MINERAL PROSPECTIVITY; ROC;
D O I
10.1016/j.cageo.2024.105703
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing geochemical data for anomaly detection using Generative Adversarial Networks (GANs) has become a prevalent method in identifying geochemical anomalies. However, injecting random noise into GANs can induce model instability. To mitigate this issue, we propose a novel anomaly detection model, Geo-Hgan, which integrates a dual adversarial network architecture with a Latent Space Adversarial Module (LSAM) to learn the distribution of latent variables from arbitrary data and optimize the sample reconstruction process, thereby alleviating instability during GAN training. Additionally, an encoder guided by the LSAM-pretrained GAN is employed to extract variational features, facilitating rapid and effective sample mapping into the latent space defined by LSAM. Experimental results demonstrate that under unsupervised conditions, Geo-Hgan achieves an Area Under the Curve (AUC) score of 85% across three geochemical datasets, outperforming similar models in accuracy and reconstruction capabilities. To assess its versatility and generalization ability, we extend Geo-Hgan to anomaly detection tasks in computer vision, where it achieves an average AUC score of 98.7% on the MvtecAD dataset, setting a new state-of-the-art performance in the domain. Furthermore, we propose AnomFilter, a method for setting anomaly thresholds based on the clustering hypothesis. AnomFilter identifies high-confidence anomaly samples identified by Geo-Hgan in the source domain and iteratively transfers them to the target domain. These high-confidence anomaly samples, combined with a small number of known positive samples in the target domain, enhance the accuracy of supervised geochemical anomaly detection in the target domain, which achieved an AUC score of 94%. The utilization of anomaly detection models for sample transfer learning offers a novel perspective for future work.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] SoftPatch: Unsupervised Anomaly Detection with Noisy Data
    Jiang, Xi
    Liu, Jianlin
    Wang, Jinbao
    Nie, Qian
    Wu, Kai
    Liu, Yong
    Wang, Chengjie
    Zheng, Feng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [42] Robust unsupervised feature selection via dual space latent representation learning and adaptive structure learning
    Li, Weiyi
    Chen, Hongmei
    Li, Tianrui
    Yin, Tengyu
    Luo, Chuan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (09) : 3025 - 3045
  • [43] Robust unsupervised feature selection via dual space latent representation learning and adaptive structure learning
    Weiyi Li
    Hongmei Chen
    Tianrui Li
    Tengyu Yin
    Chuan Luo
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3025 - 3045
  • [44] Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection
    Hu, Wenhao
    Liu, Yingying
    Xu, Jiazhen
    Chen, Xuanyu
    Wang, Gaoang
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1559 - 1564
  • [45] ALGAN: Anomaly Detection by Generating Pseudo Anomalous Data via Latent Variables
    Murase, Hironori
    Fukumizu, Kenji
    IEEE ACCESS, 2022, 10 : 44259 - 44270
  • [46] Learning Latent Representation for IoT Anomaly Detection
    Ly Vu
    Van Loi Cao
    Quang Uy Nguyen
    Nguyen, Diep N.
    Dinh Thai Hoang
    Dutkiewicz, Eryk
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (05) : 3769 - 3782
  • [47] Welding anomaly detection based on supervised learning and unsupervised learning
    发永哲
    张宝鑫
    亚伟
    Rook Remco
    Mahadevan Gautham
    Tulini Isotta
    于兴华
    China Welding, 2022, 31 (03) : 24 - 29
  • [48] A novel unsupervised framework for time series data anomaly detection via spectrum decomposition
    Lei, Tianyang
    Gong, Chang
    Chen, Gang
    Ou, Mengxin
    Yang, Kewei
    Li, Jichao
    KNOWLEDGE-BASED SYSTEMS, 2023, 280
  • [49] HYPERSPECTRAL ANOMALY DETECTION WITH DATA SPHERING AND UNSUPERVISED TARGET DETECTION
    Chen, Shuhan
    Li, Xiaorun
    Zhao, Liaoying
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1975 - 1978
  • [50] Unsupervised Anomaly Detection via Generative Adversarial Networks
    Wang, Hanling
    Li, Mingyang
    Ma, Fei
    Huang, Shao-Lun
    Zhang, Lin
    IPSN '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INFORMATION PROCESSING IN SENSOR NETWORKS, 2019, : 313 - 314