Slipstream: High-Performance Lossless Compression for Streaming Synchronized Waveform Monitoring Data

被引:6
|
作者
Blair, Steven [1 ]
Costello, Jason [1 ]
机构
[1] Synaptec, Glasgow, Lanark, Scotland
基金
欧盟地平线“2020”;
关键词
Synchrophasor; PMU; compression; CPOW; synchronized waveform; waveform measurement units (WMUs); wide-area networks;
D O I
10.1109/SGSMA51733.2022.9805997
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Fundamental changes in power grids due to decarbonization require advanced monitoring and automated analysis. Capturing synchronized waveform data from voltage and current sensors, sometimes referred to Continuous Point on Wave (CPOW) monitoring, offers several capabilities beyond synchrophasors from Phasor Measurement Units (PMUs). However, the obvious drawbacks in manipulating, transferring, and storing waveform are the high data bandwidth and storage requirements. Therefore, access to streaming synchronized waveform data is typically restricted to substation local area networks (LANs). This paper reports on a platform to address these issues and therefore to deliver wide-area waveform monitoring in a way which is convenient and practical. It is shown how a lossless data compression method designed for streaming waveform data can significantly reduce data bandwidth requirements and improve end-to-end efficiency and latency. Data bandwidth requirements can be reduced to 5-15% of the original size. The same approach can be applied to both real-time streaming and offline data storage, with reduced file size compared to other industry formats such as COMTRADE and PQDIF. It supports any sampling rate, any number of samples per message, and arbitrary configurations of measurement quantities to be sent. An implementation of the scheme, called Slipstream, has been open sourced to enable industry adoption.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] High-performance lossless RF fiber optic link
    Newberg, IL
    2000 IEEE INTERNATIONAL CONFERENCE ON PHASED ARRAY SYSTEMS AND TECHNOLOGY, PROCEEDINGS, 2000, : 375 - 378
  • [32] A lossless data compression method for an application in high energy physics
    Patauner, Christian
    Pribyl, Wolfgang
    Marchioro, Alessandro
    PRIME: PROCEEDINGS OF THE CONFERENCE 2009 PHD RESEARCH IN MICROELECTRONICS AND ELECTRONICS, 2009, : 300 - +
  • [33] Boosting the performance of LZW compression through block sorting for universal lossless data compression
    Saha, Sajib Kumar
    Rahaman, Md. Masudur
    PROCEEDINGS OF 10TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (ICCIT 2007), 2007, : 330 - +
  • [34] sPIN: High-performance streaming Processing in the Network
    Hoefler, Torsten
    Di Girolamo, Salvatore
    Taranov, Konstantin
    Grant, Ryan E.
    Brightwell, Ron
    SC'17: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2017,
  • [35] Two High-Performance Alternatives to ZLIB Scientific-Data Compression
    Almeida, Samuel
    Oliveira, Vitor
    Pina, Antonio
    Melle-Franco, Manuel
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2014, PT IV, 2014, 8582 : 623 - +
  • [36] Integrated high-performance data compression in the IBM z13
    Sofia, A. T.
    Lewis, C. C.
    Jacobi, C.
    Jamsek, D. A.
    Riedy, D. F.
    Vogt, J. -S.
    Sutton, P.
    St John, R. W.
    IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2015, 59 (4-5)
  • [37] Integrated high-performance data compression in the IBM z13
    1600, IBM Corporation (59): : 4 - 5
  • [38] Gradient Compression Supercharged High-Performance Data Parallel DNN Training
    Bai, Youhui
    Li, Cheng
    Zhou, Quan
    Yi, Jun
    Gong, Ping
    Yan, Feng
    Chen, Ruichuan
    Xu, Yinlong
    PROCEEDINGS OF THE 28TH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, SOSP 2021, 2021, : 359 - 375
  • [39] Lossless data compression programmable hardware for high-speed data networks
    Núñez, JL
    Jones, S
    2002 IEEE INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (FPT), PROCEEDINGS, 2002, : 290 - 293
  • [40] Performance Comparison of Lossless Compression Strategies for Dynamic Vision Sensor Data
    Iqbal, Khurram
    Khan, Nabeel
    Martini, Maria G.
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4427 - 4431