FOOD: Fast Out-Of-Distribution Detector

被引:1
|
作者
Amit, Guy [1 ]
Levy, Moshe [1 ]
Rosenberg, Ishai [1 ]
Shabtai, Asaf [1 ]
Elovici, Yuval [1 ]
机构
[1] Ben Gurion Univ Negev, Dept Software & Informat Syst Engn, Beer Sheva, Israel
关键词
Neural network; Out-of-Distribution; Representations;
D O I
10.1109/IJCNN52387.2021.9533465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep neural networks (DNNs) perform well at classifying inputs associated with the classes they have been trained on, which are known as in-distribution inputs. However, out-of-distribution (OOD) inputs pose a great challenge to DNNs and consequently represent a major risk when DNNs are implemented in safety-critical systems. Extensive research has been performed in the domain of OOD detection. However, current state-of-theart methods for OOD detection suffer from at least one of the following limitations: (1) increased inference time - this limits existing methods' applicability to many real-world applications, and (2) the need for OOD training data - such data can be difficult to acquire and may not be representative enough, thus limiting the ability of the OOD detector to generalize. In this paper, we propose FOOD - Fast Out-Of-Distribution detector an extended DNN classifier capable of efficiently detecting OOD samples with minimal inference time overhead. Our architecture features a DNN with a final Gaussian layer combined with the log likelihood ratio statistical test and an additional output neuron for OOD detection. Instead of using real OOD data, we use a novel method to craft artificial OOD samples from in-distribution data, which are used to train our OOD detector neuron. We evaluate FOOD's detection performance on the SVHN, CIFAR-10, and CIFAR-100 datasets. Our results demonstrate that in addition to achieving state-of-the-art performance, FOOD is fast and applicable to real-world applications.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] On Risk Assessment for Out-of-Distribution Detection
    Vasiliuk, Anton
    IEEE ACCESS, 2025, 13 : 18546 - 18568
  • [22] In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluation
    Bitterwolf, Julian
    Mueller, Maximilian
    Hein, Matthias
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202
  • [23] GOOD: A Graph Out-of-Distribution Benchmark
    Gui, Shurui
    Li, Xiner
    Wang, Limei
    Ji, Shuiwang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [24] Policy Entropy for Out-of-Distribution Classification
    Sedlmeier, Andreas
    Mueller, Robert
    Illium, Steffen
    Linnhoff-Popien, Claudia
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 420 - 431
  • [25] Semantic enhanced for out-of-distribution detection
    Jiang, Weijie
    Yu, Yuanlong
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [26] Unsupervised evaluation for out-of-distribution detection
    Zhang, Yuhang
    Hu, Jiani
    Wen, Dongchao
    Deng, Weihong
    PATTERN RECOGNITION, 2025, 160
  • [27] Causal softmax for out-of-distribution generalization
    Luo, Jing
    Zhao, Wanqing
    Peng, Jinye
    DIGITAL SIGNAL PROCESSING, 2025, 156
  • [28] Likelihood Ratios for Out-of-Distribution Detection
    Ren, Jie
    Liu, Peter J.
    Fertig, Emily
    Snoek, Jasper
    Poplin, Ryan
    DePristo, Mark A.
    Dillon, Joshua V.
    Lakshminarayanan, Balaji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [29] Generalized Out-of-Distribution Detection: A Survey
    Yang, Jingkang
    Zhou, Kaiyang
    Li, Yixuan
    Liu, Ziwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (12) : 5635 - 5662
  • [30] Semantically Coherent Out-of-Distribution Detection
    Yang, Jingkang
    Wang, Haoqi
    Feng, Litong
    Yan, Xiaopeng
    Zheng, Huabin
    Zhang, Wayne
    Liub, Ziwei
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8281 - 8289