Hyperdimensional Feature Fusion for Out-of-Distribution Detection

被引:5
|
作者
Wilson, Samuel [1 ]
Fischer, Tobias [1 ]
Sunderhauf, Niko [1 ]
Dayoub, Feras [2 ]
机构
[1] Queensland Univ Technol, 2 George St, Brisbane, Qld 4000, Australia
[2] Univ Adelaide, North Terrace, Adelaide, SA 5005, Australia
基金
澳大利亚研究理事会;
关键词
D O I
10.1109/WACV56688.2023.00267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce powerful ideas from Hyperdimensional Computing into the challenging field of Out-of-Distribution (OOD) detection. In contrast to most existing works that perform OOD detection based on only a single layer of a neural network, we use similarity-preserving semi-orthogonal projection matrices to project the feature maps from multiple layers into a common vector space. By repeatedly applying the bundling operation., we create expressive classspecific descriptor vectors for all in-distribution classes. At test time, a simple and efficient cosine similarity calculation between descriptor vectors consistently identifies OOD samples with competitive performance to the current stateof-the-art whilst being significantly faster. We show that our method is orthogonal to recent state-of-the-art OOD detectors and can be combined with them to further improve upon the performance.
引用
收藏
页码:2643 / 2653
页数:11
相关论文
共 50 条
  • [1] Exploring feature sparsity for out-of-distribution detection
    Chen, Qichao
    Li, Kuan
    Chen, Zhiyuan
    Maul, Tomas
    Yin, Jianping
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [2] Understanding the Feature Norm for Out-of-Distribution Detection
    Park, Jaewoo
    Chai, Jacky Chen Long
    Yoon, Jaeho
    Teoh, Andrew Beng Jin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1557 - 1567
  • [3] Exploiting Discrepancy in Feature Statistic for Out-of-Distribution Detection
    Guan, Xiaoyuan
    Chen, Jiankang
    Bu, Shenshen
    Zhou, Yuren
    Zheng, Wei-Shi
    Wang, Ruixuan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 18, 2024, : 19858 - 19866
  • [4] Key Feature Replacement of In-Distribution Samples for Out-of-Distribution Detection
    Kim, Jaeyoung
    Kong, Seo Taek
    Na, Dongbin
    Jung, Kyu-Hwan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 7, 2023, : 8246 - 8254
  • [5] Enhancing Out-of-Distribution Detection with Multitesting-based Layer-wise Feature Fusion
    Li, Jiawei
    Li, Sitong
    Wang, Shanshan
    Zeng, Yicheng
    Tan, Falong
    Xie, Chuanlong
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 510 - 517
  • [6] Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources
    Zheng, Haotian
    Wang, Qizhou
    Fang, Zhen
    Xia, Xiaobo
    Liu, Feng
    Liu, Tongliang
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] On the Learnability of Out-of-distribution Detection
    Fang, Zhen
    Li, Yixuan
    Liu, Feng
    Han, Bo
    Lu, Jie
    Journal of Machine Learning Research, 2024, 25
  • [8] FLaNS: Feature-Label Negative Sampling for Out-of-Distribution Detection
    Lim, Chaejin
    Hyeon, Junhee
    Lee, Kiseong
    Han, Dongil
    IEEE ACCESS, 2025, 13 : 43878 - 43888
  • [9] Entropic Out-of-Distribution Detection
    Macedo, David
    Ren, Tsang Ing
    Zanchettin, Cleber
    Oliveira, Adriano L., I
    Ludermir, Teresa
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection
    Song, Yue
    Sebe, Nicu
    Wang, Wei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,