Diffusion models for out-of-distribution detection in digital pathology

被引:0
|
作者
Linmans, Jasper [1 ]
Raya, Gabriel [2 ]
van der Laak, Jeroen [1 ,3 ]
Litjens, Geert [1 ]
机构
[1] Department of Pathology, RadboudUMC Graduate School, Radboud University Medical Center, Nijmegen, Netherlands
[2] Jheronimus Academy of Data Science, ’s-Hertogenbosch, Netherlands
[3] Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
关键词
Unsupervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
The ability to detect anomalies, i.e. anything not seen during training or out-of-distribution (OOD), in medical imaging applications is essential for successfully deploying machine learning systems. Filtering out OOD data using unsupervised learning is especially promising because it does not require costly annotations. A new class of models called AnoDDPMs, based on denoising diffusion probabilistic models (DDPMs), has recently achieved significant progress in unsupervised OOD detection. This work provides a benchmark for unsupervised OOD detection methods in digital pathology. By leveraging fast sampling techniques, we apply AnoDDPM on a large enough scale for whole-slide image analysis on the complete test set of the Camelyon16 challenge. Based on ROC analysis, we show that AnoDDPMs can detect OOD data with an AUC of up to 94.13 and 86.93 on two patch-level OOD detection tasks, outperforming the other unsupervised methods. We observe that AnoDDPMs alter the semantic properties of inputs, replacing anomalous data with more benign-looking tissue. Furthermore, we highlight the flexibility of AnoDDPM towards different information bottlenecks by evaluating reconstruction errors for inputs with different signal-to-noise ratios. While there is still a significant performance gap with fully supervised learning, AnoDDPMs show considerable promise in the field of OOD detection in digital pathology. © 2024 The Author(s)
引用
收藏
相关论文
共 50 条
  • [41] Towards In-Distribution Compatible Out-of-Distribution Detection
    Wu, Boxi
    Jiang, Jie
    Ren, Haidong
    Du, Zifan
    Wang, Wenxiao
    Li, Zhifeng
    Cai, Deng
    He, Xiaofei
    Lin, Binbin
    Liu, Wei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10333 - 10341
  • [42] Out-of-Distribution Detection Using Outlier Detection Methods
    Diers, Jan
    Pigorsch, Christian
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 15 - 26
  • [43] Exploring Large Language Models for Multi-Modal Out-of-Distribution Detection
    Dai, Yi
    Lang, Hao
    Zeng, Kaisheng
    Huang, Fei
    Li, Yongbin
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 5292 - 5305
  • [44] Improving Calibration and Out-of-Distribution Detection in Deep Models for Medical Image Segmentation
    Karimi D.
    Gholipour A.
    IEEE Transactions on Artificial Intelligence, 2023, 4 (02): : 383 - 397
  • [45] Exploring Energy-Based Models for Out-of-Distribution Detection in Dialect Identification
    Hao, Yaqian
    Hu, Chenguang
    Gao, Yingying
    Zhang, Shilei
    Feng, Junlan
    INTERSPEECH 2024, 2024, : 1640 - 1644
  • [46] On the Impact of Spurious Correlation for Out-of-Distribution Detection
    Ming, Yifei
    Yin, Hang
    Li, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 10051 - 10059
  • [47] Provable Guarantees for Understanding Out-of-Distribution Detection
    Morteza, Peyman
    Li, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7831 - 7840
  • [48] Your Out-of-Distribution Detection Method is Not Robust!
    Azizmalayeri, Mohammad
    Moakhar, Arshia Soltani
    Zarei, Arman
    Zohrabi, Reihaneh
    Manzuri, Mohammad Taghi
    Rohban, Mohammad Hossein
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [49] Learning to Augment Distributions for Out-of-Distribution Detection
    Wang, Qizhou
    Fang, Zhen
    Zhang, Yonggang
    Liu, Feng
    Li, Yixuan
    Han, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [50] CONTINUAL LEARNING FOR OUT-OF-DISTRIBUTION PEDESTRIAN DETECTION
    Molahasani, Mahdiyar
    Etemad, Ali
    Greenspan, Michael
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2685 - 2689