Slipstream: High-Performance Lossless Compression for Streaming Synchronized Waveform Monitoring Data

被引:6
|
作者
Blair, Steven [1 ]
Costello, Jason [1 ]
机构
[1] Synaptec, Glasgow, Lanark, Scotland
基金
欧盟地平线“2020”;
关键词
Synchrophasor; PMU; compression; CPOW; synchronized waveform; waveform measurement units (WMUs); wide-area networks;
D O I
10.1109/SGSMA51733.2022.9805997
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Fundamental changes in power grids due to decarbonization require advanced monitoring and automated analysis. Capturing synchronized waveform data from voltage and current sensors, sometimes referred to Continuous Point on Wave (CPOW) monitoring, offers several capabilities beyond synchrophasors from Phasor Measurement Units (PMUs). However, the obvious drawbacks in manipulating, transferring, and storing waveform are the high data bandwidth and storage requirements. Therefore, access to streaming synchronized waveform data is typically restricted to substation local area networks (LANs). This paper reports on a platform to address these issues and therefore to deliver wide-area waveform monitoring in a way which is convenient and practical. It is shown how a lossless data compression method designed for streaming waveform data can significantly reduce data bandwidth requirements and improve end-to-end efficiency and latency. Data bandwidth requirements can be reduced to 5-15% of the original size. The same approach can be applied to both real-time streaming and offline data storage, with reduced file size compared to other industry formats such as COMTRADE and PQDIF. It supports any sampling rate, any number of samples per message, and arbitrary configurations of measurement quantities to be sent. An implementation of the scheme, called Slipstream, has been open sourced to enable industry adoption.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Lossless Data Compression for Improving the Performance of a GPU-Based Beamformer
    Lok, U-Wai
    Fan, Gang-Wei
    Li, Pai-Chi
    ULTRASONIC IMAGING, 2015, 37 (02) : 135 - 151
  • [42] Performance Analysis of Hybrid Lossy/Lossless Compression Techniques for EEG Data
    Alsenwi, Madyan
    Ismail, Tawfik
    Mostafa, Hassan
    2016 28TH INTERNATIONAL CONFERENCE ON MICROELECTRONICS (ICM 2016), 2016, : 1 - 4
  • [43] Production Application Performance Data Streaming for System Monitoring
    Izadpanah, Ramin
    Allan, Benjamin A.
    Dechev, Damian
    Brandt, Jim
    ACM TRANSACTIONS ON MODELING AND PERFORMANCE EVALUATION OF COMPUTING SYSTEMS, 2019, 4 (02)
  • [44] ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression
    Schendel, Eric R.
    Jin, Ye
    Shah, Neil
    Chen, Jackie
    Chang, C. S.
    Ku, Seung-Hoe
    Ethier, Stephane
    Klasky, Scott
    Latham, Robert
    Ross, Robert
    Samatova, Nagiza F.
    2012 IEEE 28TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2012, : 138 - 149
  • [45] SnappyR: A New High-Speed Lossless Data Compression Algorithm
    Chen, Rui
    Xu, Lihao
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 334 - 334
  • [46] MAPPING DATA ON A ROTATED GRID IN HIGH-DIMENSIONS FOR LOSSLESS COMPRESSION
    Fan, Zihong
    Ortega, Antonio
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 585 - 588
  • [47] A VLSI Chip Set for High-Speed Lossless Data Compression
    Venbrux, Jack
    Yeh, Pen-Shu
    Liu, Muye N.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1992, 2 (04) : 381 - 391
  • [48] Data dependency reduction for high-performance FPGA implementation of DEFLATE compression algorithm
    Kim, Youngil
    Choi, Seungdo
    Jeong, Joonyong
    Song, Yong Ho
    JOURNAL OF SYSTEMS ARCHITECTURE, 2019, 98 : 41 - 52
  • [49] A High-Performance Media Streaming Architecture based on KVM
    Jeong, Woo-Yeong
    Lee, Youngjae
    Kim, Jin-Soo
    23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 203 - 206
  • [50] A Real-time Lossless Data Compression Method for Intelligent Train Monitoring System
    Zhou, Jian
    Wan, Guo Chun
    Li, M. M.
    2019 PHOTONICS & ELECTROMAGNETICS RESEARCH SYMPOSIUM - SPRING (PIERS-SPRING), 2019, : 3784 - 3788