CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation

被引:0
|
作者
Tashiro, Yusuke [1 ,2 ,3 ]
Song, Jiaming [1 ]
Song, Yang [1 ]
Ermon, Stefano [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[2] Mitsubishi UFJ Trust Investment Technol Inst, Tokyo, Japan
[3] Japan Digital Design, Tokyo, Japan
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The imputation of missing values in time series has many applications in healthcare and finance. While autoregressive models are natural candidates for time series imputation, score-based diffusion models have recently outperformed existing counterparts including autoregressive models in many tasks such as image generation and audio synthesis, and would be promising for time series imputation. In this paper, we propose Conditional Score-based Diffusion models for Imputation (CSDI), a novel time series imputation method that utilizes score-based diffusion models conditioned on observed data. Unlike existing score-based approaches, the conditional diffusion model is explicitly trained for imputation and can exploit correlations between observed values. On healthcare and environmental data, CSDI improves by 40-65% over existing probabilistic imputation methods on popular performance metrics. In addition, deterministic imputation by CSDI reduces the error by 5-20% compared to the state-of-the-art deterministic imputation methods. Furthermore, CSDI can also be applied to time series interpolation and probabilistic forecasting, and is competitive with existing baselines. The code is available at https://github.com/ermongroup/CSDI.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Adversarial Purification with Score-based Generative Models
    Yoon, Jongmin
    Hwang, Sung Ju
    Lee, Juho
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [22] Provable Probabilistic Imaging Using Score-Based Generative Priors
    Sun, Yu
    Wu, Zihui
    Chen, Yifan
    Feng, Berthy T.
    Bouman, Katherine L.
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 1290 - 1305
  • [23] Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
    Rasul, Kashif
    Seward, Calvin
    Schuster, Ingmar
    Vollgraf, Roland
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [24] Generating realistic neurophysiological time series with denoising diffusion probabilistic models
    Vetter, Julius
    Macke, Jakob H.
    Gao, Richard
    [J]. Patterns, 2024, 5 (09):
  • [25] Score-Based Diffusion meets Annealed Importance Sampling
    Doucet, Arnaud
    Grathwohl, Will
    Matthews, Alexander G. D. G.
    Strathmann, Heiko
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [26] Vehicular Multimodal Motion Forecasting via Conditional Score-based Modeling
    Wang, Zhangyun
    Ning, Nianwen
    Tian, Shihan
    Lu, Ning
    Cheng, Nan
    Zhou, Yi
    [J]. 2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [27] Training Energy-Based Models for Time-Series Imputation
    Brakel, Philemon
    Stroobandt, Dirk
    Schrauwen, Benjamin
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 2771 - 2797
  • [28] SCORE-BASED PARAMETER ESTIMATION FOR A CLASS OF CONTINUOUS-TIME STATE SPACE MODELS
    Beskos, Alexandros
    Crisan, Dan
    Jasra, Ajay
    Kantas, Nikolas
    Ruzayqat, Hamza
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2021, 43 (04): : A2555 - A2580
  • [29] Score-based causal learning in additive noise models
    Nowzohour, Christopher
    Buhlmann, Peter
    [J]. STATISTICS, 2016, 50 (03) : 471 - 485
  • [30] Score-Based Generative Models for Robust Channel Estimation
    Arvinte, Marius
    Tamir, Jonathan, I
    [J]. 2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 453 - 458