Deep Lossless Compression Algorithm Based on Arithmetic Coding for Power Data

被引:1
|
作者
Ma, Zhoujun [1 ,2 ]
Zhu, Hong [1 ]
He, Zhuohao [3 ]
Lu, Yue [3 ]
Song, Fuyuan [3 ]
机构
[1] State Grid Jiangsu Elect Power Co Ltd, Nanjing Power Supply Branch, Nanjing 210019, Peoples R China
[2] Hohai Univ, Coll Energy & Elect Engn, Nanjing 210098, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Minist Educ, Engn Res Ctr Digital Forens, Nanjing 210044, Peoples R China
关键词
Long Short-Term Memory; transformer; data compression; smart grid; arithmetic coding;
D O I
10.3390/s22145331
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Classical lossless compression algorithm highly relies on artificially designed encoding and quantification strategies for general purposes. With the rapid development of deep learning, data-driven methods based on the neural network can learn features and show better performance on specific data domains. We propose an efficient deep lossless compression algorithm, which uses arithmetic coding to quantify the network output. This scheme compares the training effects of Bi-directional Long Short-Term Memory (Bi-LSTM) and Transformers on minute-level power data that are not sparse in the time-frequency domain. The model can automatically extract features and adapt to the quantification of the probability distribution. The results of minute-level power data show that the average compression ratio (CR) is 4.06, which has a higher compression ratio than the classical entropy coding method.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] A unified coding algorithm of lossless and near-lossless color image compression
    Nakachi, T
    Fujii, T
    Suzuki, J
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2000, E83A (02) : 301 - 310
  • [32] A Sensor Node Lossless Compression Algorithm based on Linear Fitting Residuals Coding
    Ren Xuejun
    Ren Zhongyuan
    [J]. PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON COMPUTER MODELING AND SIMULATION (ICCMS 2018), 2017, : 62 - 66
  • [33] Novel design of arithmetic coding for data compression
    Jiang, J
    [J]. IEE PROCEEDINGS-COMPUTERS AND DIGITAL TECHNIQUES, 1995, 142 (06): : 419 - 424
  • [34] Reversible arithmetic coding for quantum data compression
    Chuang, IL
    Modha, DS
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2000, 46 (03) : 1104 - 1116
  • [35] Compression of VLSI test data by arithmetic coding
    Hashempour, H
    Lombardi, F
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON DEFECT AND FAULT TOLERANCE IN VLSI SYSTEMS, PROCEEDINGS, 2004, : 150 - 157
  • [36] An Efficient Arithmetic Coding Data Compression with Steganography
    Gomathymeenakshi, M.
    Sruti, S.
    Karthikeyan, B.
    Nayana, Meka
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN COMPUTING, COMMUNICATION AND NANOTECHNOLOGY (ICE-CCN'13), 2013, : 342 - 345
  • [37] ANALYSIS OF ARITHMETIC CODING FOR DATA-COMPRESSION
    HOWARD, PG
    VITTER, JS
    [J]. INFORMATION PROCESSING & MANAGEMENT, 1992, 28 (06) : 749 - 763
  • [38] RESEARCH ON LOSSLESS COMPRESSION CODING OF ULTRASONIC LOG DATA
    Yao, Jun-Jun
    Xin, Peng-Lai
    Yu, Qi-Jiao
    He, Hong-Bin
    [J]. 2014 SYMPOSIUM ON PIEZOELECTRICITY, ACOUSTIC WAVES, AND DEVICE APPLICATIONS (SPAWDA), 2014, : 41 - 43
  • [39] A New Semiparametric Finite Mixture Model-Based Adaptive Arithmetic Coding for Lossless Image Compression
    Masmoudi, Atef
    Masmoudi, Afif
    Puech, William
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2016, 35 (04) : 1163 - 1186
  • [40] An improved lossless image compression based arithmetic coding using mixture of non-parametric distributions
    Masmoudi, Atef
    Puech, William
    Masmoudi, Afif
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (23) : 10605 - 10619