Unsupervised Outlier Detection Using Memory and Contrastive Learning

被引:11
|
作者
Huyan, Ning [1 ]
Quan, Dou [1 ]
Zhang, Xiangrong [2 ]
Liang, Xuefeng [3 ]
Chanussot, Jocelyn [4 ]
Jiao, Licheng [5 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Shaanxi, Peoples R China
[3] Xidian Univ, Sch AI, Xian 710071, Peoples R China
[4] Grenoble Inst Technol, F-38402 Grenoble, France
[5] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Int Res Ctr Intelligent Percept & Computat, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Prototypes; Image reconstruction; Training; Memory modules; Anomaly detection; Detectors; contrastive learning; memory module; deep clustering; unsupervised learning; SUPPORT;
D O I
10.1109/TIP.2022.3211476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is to separate anomalous data from inliers in the dataset. Recently, the most deep learning methods of outlier detection leverage an auxiliary reconstruction task by assuming that outliers are more difficult to recover than normal samples (inliers). However, it is not always true in deep auto-encoder (AE) based models. The auto-encoder based detectors may recover certain outliers even if outliers are not in the training data, because they do not constrain the feature learning. Instead, we think outlier detection can be done in the feature space by measuring the distance between outliers' features and the consistency feature of inliers. To achieve this, we propose an unsupervised outlier detection method using a memory module and a contrastive learning module (MCOD). The memory module constrains the consistency of features, which merely represent the normal data. The contrastive learning module learns more discriminative features, which boosts the distinction between outliers and inliers. Extensive experiments on four benchmark datasets show that our proposed MCOD performs well and outperforms eleven state-of-the-art methods.
引用
收藏
页码:6440 / 6454
页数:15
相关论文
共 50 条
  • [1] Partition-Aware Scalable Outlier Detection Using Unsupervised Learning
    Parveen, Pallabi
    Lee, Melissa
    Henslee, Austin
    Dugan, Matt
    Ford, Brad
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IRI), 2018, : 186 - 192
  • [2] DetCo: Unsupervised Contrastive Learning for Object Detection
    Xie, Enze
    Ding, Jian
    Wang, Wenhai
    Zhan, Xiaohang
    Xu, Hang
    Sun, Peize
    Li, Zhenguo
    Luo, Ping
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8372 - 8381
  • [3] Contrastive Learning for Unsupervised Video Highlight Detection
    Badamdorj, Taivanbat
    Rochan, Mrigank
    Wang, Yang
    Cheng, Li
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14022 - 14032
  • [4] Outlier Detection on Vehicle Trajectories in Santiago, Chile using Unsupervised Deep Learning
    Soria, Richard
    Caro, Luis
    Peralta, Billy
    [J]. 2019 38TH INTERNATIONAL CONFERENCE OF THE CHILEAN COMPUTER SCIENCE SOCIETY (SCCC), 2019,
  • [5] Advanced Outlier Detection Using Unsupervised Learning for Screening Potential Customer Returns
    Hu, Hanbin
    Nguyen Nguyen
    He, Chen
    Li, Peng
    [J]. 2020 IEEE INTERNATIONAL TEST CONFERENCE (ITC), 2020,
  • [6] Cluster-Based Outlier Detection Using Unsupervised Extreme Learning Machines
    Wang, Xite
    Shen, Derong
    Bai, Mei
    Nie, Tiezheng
    Kou, Yue
    Yu, Ge
    [J]. PROCEEDINGS OF ELM-2015, VOL 1: THEORY, ALGORITHMS AND APPLICATIONS (I), 2016, 6 : 135 - 146
  • [7] Generative Adversarial Active Learning for Unsupervised Outlier Detection
    Liu, Yezheng
    Li, Zhe
    Zhou, Chong
    Jiang, Yuanchun
    Sun, Jianshan
    Wang, Meng
    He, Xiangnan
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (08) : 1517 - 1528
  • [8] DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning
    Fung, Sheldon
    Lu, Xuequan
    Zhang, Chao
    Li, Chang-Tsun
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] Multivariate functional outlier detection using the fast massive unsupervised outlier detection indices
    Ojo, Oluwasegun Taiwo
    Anta, Antonio Fernandez
    Genton, Marc G.
    Lillo, Rosa E.
    [J]. STAT, 2023, 12 (01):
  • [10] On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms
    Yamanishi, K
    Takeuchi, JI
    Williams, G
    Milne, P
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2004, 8 (03) : 275 - 300