Hierarchical One-Class Model With Subnetwork for Representation Learning and Outlier Detection

被引:13
|
作者
Zhang, Wandong [1 ]
Wu, Q. M. Jonathan [1 ]
Zhao, W. G. Will [2 ,3 ]
Deng, Haojin [4 ]
Yang, Yimin [4 ,5 ]
机构
[1] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[2] Univ Waterloo, Stratford Sch Interact Design & Business, Stratford, ON N5A 0C1, Canada
[3] Lakehead Univ, Fac Business Adm, Thunder Bay, ON P7B 5E1, Canada
[4] Lakehead Univ, Dept Comp Sci, Thunder Bay, ON P7B 5E1, Canada
[5] Univ Western Ontario, Dept Elect & Comp Engn, London, ON N6A 3K7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Nonhomogeneous media; Representation learning; Encoding; Anomaly detection; Training; Data models; Task analysis; Hierarchical network; Moore-Penrose inverse (MPI); one-class classification (OCC); representation learning; AUTOENCODERS;
D O I
10.1109/TCYB.2022.3166349
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The multilayer one-class classification (OCC) frameworks have gained great traction in research on anomaly and outlier detection. However, most multilayer OCC algorithms suffer from loosely connected feature coding, affecting the ability of generated latent space to properly generate a highly discriminative representation between object classes. To alleviate this deficiency, two novel OCC frameworks, namely: 1) OCC structure using the subnetwork neural network (OC-SNN) and 2) maximum correntropy-based OC-SNN (MCOC-SNN), are proposed in this article. The novelties of this article are as follows: 1) the subnetwork is used to build the discriminative latent space; 2) the proposed models are one-step learning networks, instead of stacking feature learning blocks and final classification layer to recognize the input pattern; 3) unlike existing works which utilize mean square error (MSE) to learn low-dimensional features, the MCOC-SNN uses maximum correntropy criterion (MCC) for discriminative feature encoding; and 4) a brand-new OCC dataset, called CO-Mask, is built for this research. Experimental results on the visual classification domain with a varying number of training samples from 6131 to 513,061 demonstrate that the proposed OC-SNN and MCOC-SNN achieve superior performance compared to the existing multilayer OCC models. For reproducibility, the source codes are available at https://github.com/W1AE/OCC.
引用
收藏
页码:6303 / 6316
页数:14
相关论文
共 50 条
  • [1] One-Class Active Learning for Outlier Detection with Multiple Subspaces
    Trittenbach, Holger
    Boehm, Klemens
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 811 - 820
  • [2] An overview and a benchmark of active learning for outlier detection with one-class classifiers
    Trittenbach, Holger
    Englhardt, Adrian
    Boehm, Klemens
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 168
  • [3] A One-Class Kernel Fisher Criterion for Outlier Detection
    Dufrenois, Franck
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (05) : 982 - 994
  • [4] Unsupervised One-Class Learning for Automatic Outlier Removal
    Liu, Wei
    Hua, Gang
    Smith, John R.
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 3826 - 3833
  • [5] On the Evaluation of Outlier Detection and One-Class Classification Methods
    Swersky, Lorne
    Marques, Henrique O.
    Sander, Jorg
    Campello, Ricardo J. G. B.
    Zimek, Arthur
    [J]. PROCEEDINGS OF 3RD IEEE/ACM INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS, (DSAA 2016), 2016, : 1 - 10
  • [6] One-class Ellipsoidal Kernel Machine for Outlier Detection
    Chen, Bin
    Li, Bin
    Pan, Zhisong
    Feng, Aimin
    [J]. PROCEEDINGS OF THE 2009 CHINESE CONFERENCE ON PATTERN RECOGNITION AND THE FIRST CJK JOINT WORKSHOP ON PATTERN RECOGNITION, VOLS 1 AND 2, 2009, : 156 - +
  • [7] Adulteration detection of edible oil by one-class classification and outlier detection
    Dou, Xinjing
    Tu, Fengqin
    Yu, Li
    Yang, Yong
    Ma, Fei
    Wang, Xuefang
    Wang, Du
    Zhang, Liangxiao
    Jiang, Xiaoming
    Li, Peiwu
    [J]. FOOD FRONTIERS, 2024, 5 (04): : 1806 - 1818
  • [8] An Adaptive Weighted One-Class SVM for Robust Outlier Detection
    Yang, Jinhong
    Deng, Tingquan
    Sui, Ran
    [J]. PROCEEDINGS OF THE 2015 CHINESE INTELLIGENT SYSTEMS CONFERENCE, VOL 1, 2016, 359 : 475 - 484
  • [9] Outlier Detection with One-Class Classifiers from ML and KDD
    Janssens, Jeroen H. M.
    Flesch, Ildiko
    Postma, Eric O.
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2009, : 147 - 153
  • [10] A Computing-in-Memory-Based One-Class Hyperdimensional Computing Model for Outlier Detection
    Wang, Ruixuan
    Moon, Sabrina Hassan
    Hu, Xiaobo Sharon
    Jiao, Xun
    Reis, Dayane
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (06) : 1559 - 1574