Deep Lossless Compression Algorithm Based on Arithmetic Coding for Power Data

被引:1
|
作者
Ma, Zhoujun [1 ,2 ]
Zhu, Hong [1 ]
He, Zhuohao [3 ]
Lu, Yue [3 ]
Song, Fuyuan [3 ]
机构
[1] State Grid Jiangsu Elect Power Co Ltd, Nanjing Power Supply Branch, Nanjing 210019, Peoples R China
[2] Hohai Univ, Coll Energy & Elect Engn, Nanjing 210098, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Minist Educ, Engn Res Ctr Digital Forens, Nanjing 210044, Peoples R China
关键词
Long Short-Term Memory; transformer; data compression; smart grid; arithmetic coding;
D O I
10.3390/s22145331
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classical lossless compression algorithm highly relies on artificially designed encoding and quantification strategies for general purposes. With the rapid development of deep learning, data-driven methods based on the neural network can learn features and show better performance on specific data domains. We propose an efficient deep lossless compression algorithm, which uses arithmetic coding to quantify the network output. This scheme compares the training effects of Bi-directional Long Short-Term Memory (Bi-LSTM) and Transformers on minute-level power data that are not sparse in the time-frequency domain. The model can automatically extract features and adapt to the quantification of the probability distribution. The results of minute-level power data show that the average compression ratio (CR) is 4.06, which has a higher compression ratio than the classical entropy coding method.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] A new coding method for lossless data compression
    [J]. Qiao, W.-X. (qiaowx@cup.edu.cn), 1600, Science Press (36):
  • [22] Wavelet based lossless image compression using partial SPIHT and bit plane based arithmetic coding
    Abu-Hajar, A
    Sankar, R
    [J]. 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 3497 - 3500
  • [23] Grouping algorithm for lossless data compression
    Tadayon, N
    Feng, GL
    Rao, TRN
    Hinds, E
    [J]. DCC '98 - DATA COMPRESSION CONFERENCE, 1998, : 574 - 574
  • [24] A lossless compression algorithm for hyperspectral data
    Gladkova, I.
    Grossberg, M.
    [J]. SATELLITE DATA COMPRESSION, COMMUNICATIONS AND ARCHIVING II, 2006, 6300
  • [25] Particle algorithm for lossless data compression
    Dianxun Shuai
    Ping Zhang
    Bin Zhang
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-6, PROCEEDINGS, 2006, : 3766 - +
  • [26] The Block Lossless Data Compression Algorithm
    Chang, Weiling
    Fang, Binxing
    Yun, Xiaochun
    Wang, Shupeng
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2009, 9 (10): : 124 - 131
  • [27] A configurable statistical lossless compression core based on variable order Markov modeling and arithmetic coding
    Nunez-Yanez, JL
    Chouliaras, VA
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2005, 54 (11) : 1345 - 1359
  • [28] An interpolative subband coding algorithm for lossless image compression
    Deng, G
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 1999, 14 (09) : 721 - 736
  • [29] Implementation of LZW Data Lossless Compression Algorithm Based on VB
    Yuan Qinghui
    Nie Xiujun
    Yuan Qingfei
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (ICCSE 2016), 2016, 68 : 37 - 44
  • [30] Lossless Compression Algorithm of Multimedia Data Based on Artificial Intelligence
    Ji, Quanpeng
    [J]. Engineering Intelligent Systems, 2022, 30 (01): : 23 - 33