Deep Lossless Compression Algorithm Based on Arithmetic Coding for Power Data

被引:1
|
作者
Ma, Zhoujun [1 ,2 ]
Zhu, Hong [1 ]
He, Zhuohao [3 ]
Lu, Yue [3 ]
Song, Fuyuan [3 ]
机构
[1] State Grid Jiangsu Elect Power Co Ltd, Nanjing Power Supply Branch, Nanjing 210019, Peoples R China
[2] Hohai Univ, Coll Energy & Elect Engn, Nanjing 210098, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Minist Educ, Engn Res Ctr Digital Forens, Nanjing 210044, Peoples R China
关键词
Long Short-Term Memory; transformer; data compression; smart grid; arithmetic coding;
D O I
10.3390/s22145331
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classical lossless compression algorithm highly relies on artificially designed encoding and quantification strategies for general purposes. With the rapid development of deep learning, data-driven methods based on the neural network can learn features and show better performance on specific data domains. We propose an efficient deep lossless compression algorithm, which uses arithmetic coding to quantify the network output. This scheme compares the training effects of Bi-directional Long Short-Term Memory (Bi-LSTM) and Transformers on minute-level power data that are not sparse in the time-frequency domain. The model can automatically extract features and adapt to the quantification of the probability distribution. The results of minute-level power data show that the average compression ratio (CR) is 4.06, which has a higher compression ratio than the classical entropy coding method.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] An improved lossless image compression based arithmetic coding using mixture of non-parametric distributions
    Masmoudi, Atef
    Puech, William
    Masmoudi, Afif
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (23) : 10605 - 10619
  • [42] A New Semiparametric Finite Mixture Model-Based Adaptive Arithmetic Coding for Lossless Image Compression
    Atef Masmoudi
    Afif Masmoudi
    William Puech
    [J]. Circuits, Systems, and Signal Processing, 2016, 35 : 1163 - 1186
  • [43] An improved lossless image compression based arithmetic coding using mixture of non-parametric distributions
    Atef Masmoudi
    William Puech
    Afif Masmoudi
    [J]. Multimedia Tools and Applications, 2015, 74 : 10605 - 10619
  • [44] AN EFFICIENT ADAPTIVE ARITHMETIC CODING FOR BLOCK-BASED LOSSLESS IMAGE COMPRESSION USING MIXTURE MODELS
    Masmoudi, Atef
    Masmoudi, Afif
    Puech, William
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 5646 - 5650
  • [45] Adaptive Entropy Coding Method for Stream-based Lossless Data Compression
    Yamagiwa, Shinichi
    Hayakawa, Eisaku
    Marumo, Koichi
    [J]. 17TH ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS 2020 (CF 2020), 2020, : 265 - 268
  • [46] A novel lossless image compression algorithm using arithmetic modulo operation
    Pattanaik, Sunil Kumar
    Mahapatra, K. K.
    Panda, G.
    [J]. 2006 IEEE CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2006, : 452 - +
  • [47] A new simple context lossless image coding algorithm based on adaptive context arithmetic coder
    Ulacha, G.
    Stasinski, R.
    [J]. PROCEEDINGS OF IWSSIP 2008: 15TH INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING, 2008, : 45 - +
  • [48] Deep Lossy Plus Residual Coding for Lossless and Near-Lossless Image Compression
    Bai, Yuanchao
    Liu, Xianming
    Wang, Kai
    Ji, Xiangyang
    Wu, Xiaolin
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (05) : 3577 - 3594
  • [49] A pattern tracking algorithm for lossless data compression
    Hebert, Thomas J.
    Karulkar, Shruti N.
    [J]. INTERNATIONAL JOURNAL OF SIGNAL AND IMAGING SYSTEMS ENGINEERING, 2011, 4 (03) : 135 - 141
  • [50] An algorithm for a lossless compression of raw radar data
    Pikacz, Bartosz
    [J]. PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2014, 2014, 9290