A Dynamic and Parallel Two-Stage Lossless Data Compression Method for Smart Grid

被引:0
|
作者
Wu, Yanxia [1 ]
Xu, Song [2 ]
Xi, Caiping [2 ]
Nie, Pengqiang [2 ]
Jiang, Wei [3 ]
Hashimoto, Seiji [4 ]
机构
[1] Jiangsu Univ Sci & Technol, Ocean Coll, Zhenjiang 212000, Peoples R China
[2] Jiangsu Univ Sci & Technol, Coll Automat, Zhenjiang 212000, Peoples R China
[3] Yangzhou Univ, Coll Elect Energy & Power Engn, Yangzhou 215000, Peoples R China
[4] Gunma Univ, Div Elect & Informat, Kiryu, Gunma 3768515, Japan
关键词
Lossless data compression; smart grid; Huffman algorithm; LZW algorithm; MODEL;
D O I
10.1109/ACCESS.2023.3343436
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of smart grid (SG) technologies, massive system data has been generated for SG for grid operation status monitoring and fault warning, this massive integrated data has brought great challenges for data transmission and storage. Thus, the breakthrough of data compression technology has become more and more important for data processing, this proposal, a lossless data compression method is proposed. The proposed method improves the Lempel-Ziv-Welch (LZW) algorithm. Specifically, the proposed method employs a parallel search approach to search the index of the dictionary globally by dividing the dictionary into several small dictionaries of different sizes and bit widths. In addition, the dynamic variable-length coding method is used as the output code which can offer flexible bit widths instead of fixed values, and the optimal dictionary partition combination and size parameters are selected to construct dictionaries. At last, the improved algorithm is cascaded with Huffman algorithm to form the proposed data compression algorithm. The data compression efficiency has been successfully verified by comparing with conventional Huffman and LZW data compression algorithms through data simulation, and it is observed to offer a better compression ratio than those methods with only LZW algorithm or Huffman algorithm, and save storage space effectively. More than this, the proposed method has realized lossless compression for power system data and guaranteed the integrity of the data, which will have better applicability for dealing with any similar information data.
引用
收藏
页码:143475 / 143485
页数:11
相关论文
共 50 条
  • [21] Hierarchical dispatch using two-stage optimisation for electricity markets in smart grid
    Yang, Jie
    Zhang, Guoshan
    Ma, Kai
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2016, 47 (15) : 3529 - 3536
  • [22] An Optimized Two-Stage Method for Ultrasound Breast Image Compression
    Sahba, N.
    Tavakoli, V.
    Behnam, H.
    Ahmadian, A.
    Ahmadinejad, N.
    Alirezaies, J.
    4TH KUALA LUMPUR INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING 2008, VOLS 1 AND 2, 2008, 21 (1-2): : 515 - +
  • [23] Lossless Compression of Synchro-Waveform Measurements for Smart Grid Monitoring
    Qiu, Wei
    Yin, He
    Wu, Yuru
    Chen, Chang
    Zeng, Chujie
    Zhan, Lingwei
    Liu, Yilu
    2023 IEEE PES CONFERENCE ON INNOVATIVE SMART GRID TECHNOLOGIES, ISGT MIDDLE EAST, 2023,
  • [24] Two-stage Evaluation Method of Dynamic Network DEA
    Liu, Jianyong
    Pang, Kun
    Li, Ling
    Fu, Chengqun
    Guo, Jie
    ADVANCED RESEARCH ON INDUSTRY, INFORMATION SYSTEMS AND MATERIAL ENGINEERING, PTS 1-7, 2011, 204-210 : 583 - 588
  • [25] An efficient two-stage Markov chain Monte Carlo method for dynamic data integration
    Efendiev, Y
    Datta-Gupta, A
    Ginting, V
    Ma, X
    Mallick, B
    WATER RESOURCES RESEARCH, 2005, 41 (12) : 1 - 6
  • [26] Lightweight authentication scheme for smart grid using Merkle hash tree and lossless compression hybrid method
    Tohidi, Hamed
    Vakili, Vahid Tabataba
    IET COMMUNICATIONS, 2018, 12 (19) : 2478 - 2484
  • [27] Two-Stage Golomb - Context-Adaptive Binary Arithmetic Coders Coding in Lossless Image Compression
    Frydrychowicz, Malgorzata
    Ulacha, Grzegorz
    ADVANCES IN SCIENCE AND TECHNOLOGY-RESEARCH JOURNAL, 2024, 18 (06) : 62 - 85
  • [28] Single- or two-stage compression
    Jekel, Todd B.
    Reindl, Douglas T.
    ASHRAE JOURNAL, 2008, 50 (08) : 46 - +
  • [29] Investigation of two-stage compression of gas
    V. M. Shmelev
    V. M. Nikolaev
    V. S. Ilyukhin
    D. B. Volov
    High Temperature, 2008, 46 : 77 - 83
  • [30] Investigation of two-stage compression of gas
    Shmelev, V. M.
    Nikolaev, V. M.
    Ilyukhin, V. S.
    Volov, D. B.
    HIGH TEMPERATURE, 2008, 46 (01) : 77 - 83