Slipstream: High-Performance Lossless Compression for Streaming Synchronized Waveform Monitoring Data

被引:6
|
作者
Blair, Steven [1 ]
Costello, Jason [1 ]
机构
[1] Synaptec, Glasgow, Lanark, Scotland
基金
欧盟地平线“2020”;
关键词
Synchrophasor; PMU; compression; CPOW; synchronized waveform; waveform measurement units (WMUs); wide-area networks;
D O I
10.1109/SGSMA51733.2022.9805997
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Fundamental changes in power grids due to decarbonization require advanced monitoring and automated analysis. Capturing synchronized waveform data from voltage and current sensors, sometimes referred to Continuous Point on Wave (CPOW) monitoring, offers several capabilities beyond synchrophasors from Phasor Measurement Units (PMUs). However, the obvious drawbacks in manipulating, transferring, and storing waveform are the high data bandwidth and storage requirements. Therefore, access to streaming synchronized waveform data is typically restricted to substation local area networks (LANs). This paper reports on a platform to address these issues and therefore to deliver wide-area waveform monitoring in a way which is convenient and practical. It is shown how a lossless data compression method designed for streaming waveform data can significantly reduce data bandwidth requirements and improve end-to-end efficiency and latency. Data bandwidth requirements can be reduced to 5-15% of the original size. The same approach can be applied to both real-time streaming and offline data storage, with reduced file size compared to other industry formats such as COMTRADE and PQDIF. It supports any sampling rate, any number of samples per message, and arbitrary configurations of measurement quantities to be sent. An implementation of the scheme, called Slipstream, has been open sourced to enable industry adoption.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Low-Overhead Compressibility Prediction for High-Performance Lossless Data Compression
    Kim, Youngil
    Choi, Seungdo
    Lee, Daeyong
    Jeong, Joonyong
    Kwak, Jaewook
    Lee, Jungkeol
    Lee, Gyeongyong
    Lee, Sangjin
    Park, Kibin
    Jeong, Jinwoo
    Kexin, Wang
    Song, Yong Ho
    IEEE ACCESS, 2020, 8 : 37105 - 37123
  • [2] Clinical evaluation of high-performance lossless image compression
    Daniell, AL
    Jin, MY
    Valentino, DJ
    MEDICAL IMAGING 1998 - PACS DESIGN AND EVALUATION: ENGINEERING AND CLINICAL ISSUES, 1998, 3339 : 39 - 51
  • [3] High performance lossless compression of scientific floating data
    He K.-J.
    Jisuanji Xuebao/Chinese Journal of Computers, 2010, 33 (06): : 966 - 976
  • [4] AOCL-Compression - A high performance optimized lossless data compression library
    Raut, S. Biplab
    2023 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE, HPEC, 2023,
  • [5] Bit-Error Aware Lossless Compression of Waveform Data
    Tan, Li
    Jiang, Jean
    Zhang, Yunlong
    IEEE SIGNAL PROCESSING LETTERS, 2010, 17 (06) : 547 - 550
  • [6] Lossless Compression of Synchro-Waveform Measurements for Smart Grid Monitoring
    Qiu, Wei
    Yin, He
    Wu, Yuru
    Chen, Chang
    Zeng, Chujie
    Zhan, Lingwei
    Liu, Yilu
    2023 IEEE PES CONFERENCE ON INNOVATIVE SMART GRID TECHNOLOGIES, ISGT MIDDLE EAST, 2023,
  • [7] Lossless Data Compression Techniques and Their Performance
    Sharma, Komal
    Gupta, Kunal
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2017, : 256 - 261
  • [8] Fuzzy blending of relaxation labeled predictors for high-performance lossless image compression
    Aiazzi, B
    Alparone, L
    Baronti, S
    APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS IN IMAGE PROCESSING V, 2000, 3962 : 41 - 49
  • [9] A TECHNIQUE FOR HIGH-PERFORMANCE DATA-COMPRESSION
    WELCH, TA
    COMPUTER, 1984, 17 (06) : 8 - 19
  • [10] Performance of lossless compression algorithms on voiceband data
    Ng, KW
    Pollard, AJ
    Dacombe, LR
    McLeod, RD
    Card, HC
    1996 CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING - CONFERENCE PROCEEDINGS, VOLS I AND II: THEME - GLIMPSE INTO THE 21ST CENTURY, 1996, : 206 - 209