Hyperdimensional Feature Fusion for Out-of-Distribution Detection

被引:5
|
作者
Wilson, Samuel [1 ]
Fischer, Tobias [1 ]
Sunderhauf, Niko [1 ]
Dayoub, Feras [2 ]
机构
[1] Queensland Univ Technol, 2 George St, Brisbane, Qld 4000, Australia
[2] Univ Adelaide, North Terrace, Adelaide, SA 5005, Australia
基金
澳大利亚研究理事会;
关键词
D O I
10.1109/WACV56688.2023.00267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce powerful ideas from Hyperdimensional Computing into the challenging field of Out-of-Distribution (OOD) detection. In contrast to most existing works that perform OOD detection based on only a single layer of a neural network, we use similarity-preserving semi-orthogonal projection matrices to project the feature maps from multiple layers into a common vector space. By repeatedly applying the bundling operation., we create expressive classspecific descriptor vectors for all in-distribution classes. At test time, a simple and efficient cosine similarity calculation between descriptor vectors consistently identifies OOD samples with competitive performance to the current stateof-the-art whilst being significantly faster. We show that our method is orthogonal to recent state-of-the-art OOD detectors and can be combined with them to further improve upon the performance.
引用
收藏
页码:2643 / 2653
页数:11
相关论文
共 50 条
  • [31] Deep Relevant Feature Focusing for Out-of-Distribution Generalization
    Wang, Fawu
    Zhang, Kang
    Liu, Zhengyu
    Yuan, Xia
    Zhao, Chunxia
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 245 - 253
  • [32] Understanding and Improving Feature Learning for Out-of-Distribution Generalization
    Chen, Yongqiang
    Huang, Wei
    Zhou, Kaiwen
    Bian, Yatao
    Han, Bo
    Cheng, James
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [33] Out-of-Distribution Detection in Deep Learning Models: A Feature Space-Based Approach
    Carvalho, Thiago Medeiros
    Vellasco, Marley
    Amaral, Jose Franco
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [34] RONF: Reliable Outlier Synthesis under Noisy Feature Space for Out-of-Distribution Detection
    He, Rundong
    Han, Zhongyi
    Lu, Xiankai
    Yin, Yilong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4242 - 4251
  • [35] Towards In-Distribution Compatible Out-of-Distribution Detection
    Wu, Boxi
    Jiang, Jie
    Ren, Haidong
    Du, Zifan
    Wang, Wenxiao
    Li, Zhifeng
    Cai, Deng
    He, Xiaofei
    Lin, Binbin
    Liu, Wei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10333 - 10341
  • [36] FLatS: Principled Out-of-Distribution Detection with Feature-Based Likelihood Ratio Score
    Lin, Haowei
    Gu, Yuntian
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 8956 - 8963
  • [37] Out-of-Distribution Detection Using Outlier Detection Methods
    Diers, Jan
    Pigorsch, Christian
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 15 - 26
  • [38] On the Impact of Spurious Correlation for Out-of-Distribution Detection
    Ming, Yifei
    Yin, Hang
    Li, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 10051 - 10059
  • [39] Provable Guarantees for Understanding Out-of-Distribution Detection
    Morteza, Peyman
    Li, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7831 - 7840
  • [40] Your Out-of-Distribution Detection Method is Not Robust!
    Azizmalayeri, Mohammad
    Moakhar, Arshia Soltani
    Zarei, Arman
    Zohrabi, Reihaneh
    Manzuri, Mohammad Taghi
    Rohban, Mohammad Hossein
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,