Interpretable Latent Space for Meteorological Out-of-Distribution Detection via Weak Supervision

被引:0
|
作者
Das, Suman [1 ]
Yuhas, Michael [1 ]
Koh, Rachel [1 ]
Easwaran, Arvind [1 ]
机构
[1] Nanyang Technol Univ, 50 Nanyang Ave,32 Block N4 02a, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Safety critical system; rain detection; lightness detection; representation learning; autonomous vehicle;
D O I
10.1145/3651224
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep neural networks (DNNs) are effective tools for learning-enabled cyber-physical systems (CPSs) that handle high-dimensional image data. However, DNNs may make incorrect decisions when presented with inputs outside the distribution of their training data. These inputs can compromise the safety of CPSs. So, it becomes crucial to detect inputs as out-of-distribution (OOD) and interpret the reasons for their classification as OOD. In this study, we propose an interpretable learning method to detect OOD caused by meteorological features like darkness, lightness, and rain. To achieve this, we employ a variational autoencoder (VAE) to map high-dimensional image data to a lower-dimensional latent space. We then focus on a specific latent dimension and encourage it to classify different intensities of a particular meteorological feature in a monotonically increasing manner. This is accomplished by incorporating two additional terms into the VAE's loss function: a classification loss and a positional loss. During training, we optimize the utilization of label information for classification. Remarkably, our results demonstrate that using only 25% of the training data labels is sufficient to train a single pre-selected latent dimension to classify different intensities of a specific meteorological feature. We evaluate the proposed method on two distinct datasets, CARLA and Duckietown, employing two different rain-generation methods. We show that our approach outperforms existing approaches by at least 15% in the F1 score and precision when trained and tested on CARLA dataset.
引用
收藏
页码:1 / 26
页数:26
相关论文
共 50 条
  • [1] Latent Transformer Models for out-of-distribution detection
    Graham, Mark S.
    Tudosiu, Petru-Daniel
    Wright, Paul
    Pinaya, Walter Hugo Lopez
    Teikari, Petteri
    Patel, Ashay
    U-King-Im, Jean-Marie
    Mah, Yee H.
    Teo, James T.
    Jager, Hans Rolf
    Werring, David
    Rees, Geraint
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    MEDICAL IMAGE ANALYSIS, 2023, 90
  • [2] Exploring transition states of protein conformational changes via out-of-distribution detection in the hyperspherical latent space
    Bojun Liu
    Jordan G. Boysen
    Ilona Christy Unarta
    Xuefeng Du
    Yixuan Li
    Xuhui Huang
    Nature Communications, 16 (1)
  • [3] Out-of-Distribution Detection in Multi-Label Datasets using Latent Space of β-VAE
    Sundar, Vijaya Kumar
    Ramakrishna, Shreyas
    Rahiminasab, Zahra
    Easwaran, Arvind
    Dubey, Abhishek
    2020 IEEE SYMPOSIUM ON SECURITY AND PRIVACY WORKSHOPS (SPW 2020), 2020, : 250 - 255
  • [4] Supervision Adaptation Balancing In-Distribution Generalization and Out-of-Distribution Detection
    Zhao, Zhilin
    Cao, Longbing
    Lin, Kun-Yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15743 - 15758
  • [5] Efficient Out-of-Distribution Detection Using Latent Space of β-VAE for Cyber-Physical Systems
    Ramakrishna, Shreyas
    Rahiminasab, Zahra
    Karsai, Gabor
    Easwaran, Arvind
    Dubey, Abhishek
    ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2022, 6 (02)
  • [6] Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources
    Zheng, Haotian
    Wang, Qizhou
    Fang, Zhen
    Xia, Xiaobo
    Liu, Feng
    Liu, Tongliang
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] Principled Out-of-Distribution Detection via Multiple Testing
    Magesh, Akshayaa
    Veeravalli, Venugopal V.
    Roy, Anirban
    Jha, Susmit
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [8] On the Learnability of Out-of-distribution Detection
    Fang, Zhen
    Li, Yixuan
    Liu, Feng
    Han, Bo
    Lu, Jie
    Journal of Machine Learning Research, 2024, 25
  • [9] Watermarking for Out-of-distribution Detection
    Wang, Qizhou
    Liu, Feng
    Zhang, Yonggang
    Zhang, Jing
    Gong, Chen
    Liu, Tongliang
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Entropic Out-of-Distribution Detection
    Macedo, David
    Ren, Tsang Ing
    Zanchettin, Cleber
    Oliveira, Adriano L., I
    Ludermir, Teresa
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,