DTIN: Dual Transformer-based Imputation Nets for multivariate time series emitter missing data

被引:1
|
作者
Sun, Ziyue [1 ]
Li, Haozhe [1 ]
Wang, Wenhai [1 ]
Liu, Jiaqi [2 ]
Liu, Xinggao [1 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, Hangzhou 310027, Peoples R China
[2] China Acad, Launch Vehicle Technol, Beijing 100000, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Multivariate time series; Missing data imputation; Dual channel; Transformer; Pivotal tuning inversion; VALUES; REGRESSION;
D O I
10.1016/j.knosys.2023.111270
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a kind of multivariate time series (MTS) data, emitter signals often exhibit missing or corrupt values, posing serious challenges to emitter data research such as specific emitter identification (SEI). Existing multivariate missing data imputation (MDI) methods are deficient in two aspects when applied to MTS emitter data: first, single-channel models cannot handle variables with varying numbers of complete samples; second, they cannot efficiently impute MTS data that are out of the model's domain. To address these issues, a dual channel architecture tailored for MTS emitter data was devised in this study, which is called Dual Transformer based Imputation Nets (DTIN). DTIN processes different types of variables through two parallel channels to extract different spatiotemporal features. Furthermore, drawing inspiration from image style manipulation, multivariate time series pivotal tuning inversion (MTSPTI) techniques are employed for better imputation performance, in which an in-domain pivotal code is created and input into the generator that is tuned for out-of-domain MTS emitter data. Extensive experiments on two real-world emitter datasets demonstrate that DTIN outperforms several existing MDI models.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Method of missing data imputation for multivariate time series
    [J]. 2018, Chinese Institute of Electronics (40):
  • [2] Combining Convolution and Transformer for Missing Time Series Data Imputation
    Wang, Yi-Fan
    Bu, Shuai-Yu
    Yan, Jing-Hua
    Hou, Zhi-Wen
    Bu, Ling-Bin
    Meng, Fan-Xu
    [J]. Journal of Network Intelligence, 2023, 8 (03): : 823 - 838
  • [3] A Transformer-based Framework for Multivariate Time Series Representation Learning
    Zerveas, George
    Jayaraman, Srideepika
    Patel, Dhaval
    Bhamidipaty, Anuradha
    Eickhoff, Carsten
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 2114 - 2124
  • [4] Data Imputation for Multivariate Time Series Sensor Data With Large Gaps of Missing Data
    Wu, Rui
    Hamshaw, Scott D.
    Yang, Lei
    Kincaid, Dustin W.
    Etheridge, Randall
    Ghasemkhani, Amir
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (11) : 10671 - 10683
  • [5] Multivariate time series anomaly detection via separation, decomposition, and dual transformer-based autoencoder
    Fu, Shiyuan
    Gao, Xin
    Li, Baofeng
    Zhai, Feng
    Lu, Jiansheng
    Xue, Bing
    Yu, Jiahao
    Xiao, Chun
    [J]. APPLIED SOFT COMPUTING, 2024, 159
  • [6] Missing data imputation in a transformer district based on time series imagingencoding and a generative adversarial network
    Liu, Keyan
    Zhou, Fangze
    Zhou, Hui
    [J]. Dianli Xitong Baohu yu Kongzhi/Power System Protection and Control, 2022, 50 (24): : 129 - 136
  • [7] Multivariate Time Series Missing Data Imputation Using Recurrent Denoising Autoencoder
    Zhang, Jianye
    Yin, Peng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 760 - 764
  • [8] Recurrent Imputation for Multivariate Time Series with Missing Values
    Suo, Qiuling
    Yao, Liuyi
    Xun, Guangxu
    Sun, Jianhui
    Zhang, Aidong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2019, : 562 - 564
  • [9] Variational transformer-based anomaly detection approach for multivariate time series
    Wang, Xixuan
    Pi, Dechang
    Zhang, Xiangyan
    Liu, Hao
    Guo, Chang
    [J]. MEASUREMENT, 2022, 191
  • [10] Foreformer: an enhanced transformer-based framework for multivariate time series forecasting
    Ye Yang
    Jiangang Lu
    [J]. Applied Intelligence, 2023, 53 : 12521 - 12540