CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation

被引:0
|
作者
Tashiro, Yusuke [1 ,2 ,3 ]
Song, Jiaming [1 ]
Song, Yang [1 ]
Ermon, Stefano [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[2] Mitsubishi UFJ Trust Investment Technol Inst, Tokyo, Japan
[3] Japan Digital Design, Tokyo, Japan
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The imputation of missing values in time series has many applications in healthcare and finance. While autoregressive models are natural candidates for time series imputation, score-based diffusion models have recently outperformed existing counterparts including autoregressive models in many tasks such as image generation and audio synthesis, and would be promising for time series imputation. In this paper, we propose Conditional Score-based Diffusion models for Imputation (CSDI), a novel time series imputation method that utilizes score-based diffusion models conditioned on observed data. Unlike existing score-based approaches, the conditional diffusion model is explicitly trained for imputation and can exploit correlations between observed values. On healthcare and environmental data, CSDI improves by 40-65% over existing probabilistic imputation methods on popular performance metrics. In addition, deterministic imputation by CSDI reduces the error by 5-20% compared to the state-of-the-art deterministic imputation methods. Furthermore, CSDI can also be applied to time series interpolation and probabilistic forecasting, and is competitive with existing baselines. The code is available at https://github.com/ermongroup/CSDI.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Model Abstraction and Conditional Sampling with Score-Based Diffusion Models
    Bortolussi, Luca
    Cairoli, Francesca
    Giacomarra, Francesco
    Scassola, Davide
    [J]. QUANTITATIVE EVALUATION OF SYSTEMS, QEST 2023, 2023, 14287 : 307 - 310
  • [2] PET Image Denoising with Score-Based Diffusion Probabilistic Models
    Shen, Chenyu
    Yang, Ziyuan
    Zhang, Yi
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 270 - 278
  • [3] Conditional score-based diffusion models for Bayesian inference in infinite dimensions
    Baldassari, Lorenzo
    Siahkoohi, Ali
    Garnier, Josselin
    Solna, Knut
    de Hoop, Maarten V.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [4] Conditional score-based diffusion models for solving inverse elasticity problems
    Dasgupta, Agnimitra
    Ramaswamy, Harisankar
    Murgoitio-Esandi, Javier
    Foo, Ken Y.
    Li, Runze
    Zhou, Qifa
    Kennedy, Brendan F.
    Oberai, Assad A.
    [J]. Computer Methods in Applied Mechanics and Engineering, 2025, 433
  • [5] Score-based diffusion models for accelerated MRI
    Chung, Hyungjin
    Ye, Jong Chul
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 80
  • [6] Imputation-based Time-Series Anomaly Detection with Conditional Weight-Incremental Diffusion Models
    Xiao, Chunjing
    Gou, Zehua
    Tai, Wenxin
    Zhang, Kunpeng
    Zhou, Fan
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2742 - 2751
  • [7] A Missing Well- Logs Imputation Method Based on Conditional Denoising Diffusion Probabilistic Models
    Meng, Han
    Lin, Botao
    Zhang, Ruxin
    Jin, Yan
    [J]. SPE JOURNAL, 2024, 29 (05): : 2165 - 2180
  • [8] Maximum Likelihood Training of Score-Based Diffusion Models
    Song, Yang
    Durkan, Conor
    Murray, Iain
    Ermon, Stefano
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [9] Optimal Transport-Guided Conditional Score-Based Diffusion Model
    Gu, Xiang
    Yang, Liwei
    Sun, Jian
    Xu, Zongben
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [10] SCORE-BASED DIFFUSION MODELS FOR BAYESIAN IMAGE RECONSTRUCTION
    McCann, Michael T.
    Chung, Hyungjin
    Ye, Jong Chul
    Klasky, Marc L.
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 111 - 115