Deep Lossless Compression Algorithm Based on Arithmetic Coding for Power Data

被引:1
|
作者
Ma, Zhoujun [1 ,2 ]
Zhu, Hong [1 ]
He, Zhuohao [3 ]
Lu, Yue [3 ]
Song, Fuyuan [3 ]
机构
[1] State Grid Jiangsu Elect Power Co Ltd, Nanjing Power Supply Branch, Nanjing 210019, Peoples R China
[2] Hohai Univ, Coll Energy & Elect Engn, Nanjing 210098, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Minist Educ, Engn Res Ctr Digital Forens, Nanjing 210044, Peoples R China
关键词
Long Short-Term Memory; transformer; data compression; smart grid; arithmetic coding;
D O I
10.3390/s22145331
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classical lossless compression algorithm highly relies on artificially designed encoding and quantification strategies for general purposes. With the rapid development of deep learning, data-driven methods based on the neural network can learn features and show better performance on specific data domains. We propose an efficient deep lossless compression algorithm, which uses arithmetic coding to quantify the network output. This scheme compares the training effects of Bi-directional Long Short-Term Memory (Bi-LSTM) and Transformers on minute-level power data that are not sparse in the time-frequency domain. The model can automatically extract features and adapt to the quantification of the probability distribution. The results of minute-level power data show that the average compression ratio (CR) is 4.06, which has a higher compression ratio than the classical entropy coding method.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Arithmetic coding based lossless compression schemes for power system steady state operational data
    Das, Sarasij
    Rao, P. S. Nagendra
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2012, 43 (01) : 47 - 53
  • [2] ISSDC DIGRAM CODING BASED LOSSLESS DATA COMPRESSION ALGORITHM
    Mesut, Altan
    Carus, Aydin
    [J]. COMPUTING AND INFORMATICS, 2010, 29 (05) : 741 - 756
  • [3] A separate least squares algorithm for efficient arithmetic coding in lossless image compression
    Triantafyllidis, GA
    Strintzis, MG
    [J]. W S C G ' 2001, VOLS I & II, CONFERENCE PROCEEDINGS, 2001, : 315 - 319
  • [4] Lossless Image Compression Based on Multiple-Tables Arithmetic Coding
    Chen, Rung-Ching
    Pai, Pei-Yan
    Chan, Yung-Kuan
    Chang, Chin-Chen
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2009, 2009
  • [5] A context based adaptive arithmetic coding technique for lossless image compression
    Triantafyllidis, GA
    Strintzis, MG
    [J]. IEEE SIGNAL PROCESSING LETTERS, 1999, 6 (07) : 168 - 170
  • [6] ARITHMETIC CODING IN LOSSLESS WAVE-FORM COMPRESSION
    STEARNS, SD
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1995, 43 (08) : 1874 - 1879
  • [7] An improved lossless image compression algorithm based on Huffman coding
    Liu, Xiaoxiao
    An, Ping
    Chen, Yilei
    Huang, Xinpeng
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 4781 - 4795
  • [8] An improved lossless image compression algorithm based on Huffman coding
    Xiaoxiao Liu
    Ping An
    Yilei Chen
    Xinpeng Huang
    [J]. Multimedia Tools and Applications, 2022, 81 : 4781 - 4795
  • [9] High fidelity image compression with nearly lossless arithmetic coding
    Wang, HJ
    Kuo, CCJ
    [J]. MULTIMEDIA STORAGE AND ARCHIVING SYSTEMS, 1996, 2916 : 66 - 77
  • [10] NEW METHODS FOR LOSSLESS IMAGE COMPRESSION USING ARITHMETIC CODING
    HOWARD, PG
    VITTER, JS
    [J]. INFORMATION PROCESSING & MANAGEMENT, 1992, 28 (06) : 765 - 779