A Dynamic and Parallel Two-Stage Lossless Data Compression Method for Smart Grid

被引:0
|
作者
Wu, Yanxia [1 ]
Xu, Song [2 ]
Xi, Caiping [2 ]
Nie, Pengqiang [2 ]
Jiang, Wei [3 ]
Hashimoto, Seiji [4 ]
机构
[1] Jiangsu Univ Sci & Technol, Ocean Coll, Zhenjiang 212000, Peoples R China
[2] Jiangsu Univ Sci & Technol, Coll Automat, Zhenjiang 212000, Peoples R China
[3] Yangzhou Univ, Coll Elect Energy & Power Engn, Yangzhou 215000, Peoples R China
[4] Gunma Univ, Div Elect & Informat, Kiryu, Gunma 3768515, Japan
关键词
Lossless data compression; smart grid; Huffman algorithm; LZW algorithm; MODEL;
D O I
10.1109/ACCESS.2023.3343436
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of smart grid (SG) technologies, massive system data has been generated for SG for grid operation status monitoring and fault warning, this massive integrated data has brought great challenges for data transmission and storage. Thus, the breakthrough of data compression technology has become more and more important for data processing, this proposal, a lossless data compression method is proposed. The proposed method improves the Lempel-Ziv-Welch (LZW) algorithm. Specifically, the proposed method employs a parallel search approach to search the index of the dictionary globally by dividing the dictionary into several small dictionaries of different sizes and bit widths. In addition, the dynamic variable-length coding method is used as the output code which can offer flexible bit widths instead of fixed values, and the optimal dictionary partition combination and size parameters are selected to construct dictionaries. At last, the improved algorithm is cascaded with Huffman algorithm to form the proposed data compression algorithm. The data compression efficiency has been successfully verified by comparing with conventional Huffman and LZW data compression algorithms through data simulation, and it is observed to offer a better compression ratio than those methods with only LZW algorithm or Huffman algorithm, and save storage space effectively. More than this, the proposed method has realized lossless compression for power system data and guaranteed the integrity of the data, which will have better applicability for dealing with any similar information data.
引用
收藏
页码:143475 / 143485
页数:11
相关论文
共 50 条
  • [1] A New Architecture of a Two-Stage Lossless Data Compression and Decompression Algorithm
    Lin, Ming-Bo
    Chang, Yung-Yi
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2009, 17 (09) : 1297 - 1303
  • [2] Effect of encoders on the performance of lossless two-stage data compression schemes
    Logeswaran, R
    Eswaran, C
    ELECTRONICS LETTERS, 1999, 35 (18) : 1515 - 1516
  • [3] Parallel lossless data compression: A particle dynamic approach
    Shuai, Dianxun
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, PROCEEDINGS: WITH ASPECTS OF THEORETICAL AND METHODOLOGICAL ISSUES, 2008, 5226 : 266 - 274
  • [4] Two-stage lossy/lossless compression of grayscale document images
    Popat, K
    Bloomberg, DS
    MATHEMATICAL MORPHOLOGY AND ITS APPLICATIONS TO IMAGE AND SIGNAL PROCESSING, 2000, 18 : 361 - 370
  • [5] Three-Stage Lossless Compression Technique For Processing PMU Big Data In Modern Smart Grid
    Li Baojie
    Chen Shuo
    Lu Yuxin
    He Weisheng
    Zeng Xiaoming
    PROCEEDINGS OF THE 2017 2ND JOINT INTERNATIONAL INFORMATION TECHNOLOGY, MECHANICAL AND ELECTRONIC ENGINEERING CONFERENCE (JIMEC 2017), 2017, 62 : 59 - 63
  • [6] A Two-stage Pattern Recognition Method for Electric Customer Classification in Smart Grid
    Peng, Bo
    Wan, Can
    Dong, Shufeng
    Lin, Jin
    Song, Yonghua
    Zhang, Yi
    Xiong, Jun
    2016 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2016,
  • [7] Dynamic Trajectory Prediction and Stability Assessment for Power Grid Based on Two-stage Information Compression
    Liu J.
    Liu J.
    Li Y.
    Wang G.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (20): : 13 - 22
  • [8] An Efficient Lossless Compression Scheme for Hyperspectral Images Using Two-Stage Prediction
    Lin, Cheng-Chen
    Hwang, Yin-Tsung
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2010, 7 (03) : 558 - 562
  • [9] A Fully Embedded Two-Stage Coder for Hyperspectral Near-Lossless Compression
    Beerten, Jente
    Blanes, Ian
    Serra-Sagrista, Joan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (08) : 1775 - 1779
  • [10] A two-stage parallel hybrid method for power system dynamic security assessment
    Kyesswa, Michael
    Cakmak, Hueseyin K.
    Kuehnapfel, Uwe
    Hagenmeyer, Veit
    AT-AUTOMATISIERUNGSTECHNIK, 2023, 71 (12) : 1002 - 1017