Design of new format for mass data compression

被引:3
|
作者
QIN Jian-cheng
机构
关键词
mass data coding; lossless compression; LZ77/LZSS algorithm; arithmetic coding;
D O I
暂无
中图分类号
TP274 [数据处理、数据处理系统];
学科分类号
0804 ; 080401 ; 080402 ; 081002 ; 0835 ;
摘要
In the field of lossless compression,most kinds of traditional software have some shortages when they face the mass data.Their compressing abilities are limited by the data window size and the compressing format design.This paper presents a new design of compressing format named ’CZ format’ which supports the data window size up to 4 GB and has some advantages in the mass data compression.Using this format,a compressing shareware named ’ComZip’ is designed.The experiment results support that ComZip has better compression ratio than WinZip,Bzip2 and WinRAR in most cases,especially when GBs or TBs of mass data are compressed.And ComZip has the potential to beat 7-zip in future as the data window size exceeds 128 MB.
引用
收藏
页码:121 / 128
页数:8
相关论文
共 50 条
  • [1] Design of new format for mass data compression
    Qin J.-C.
    Bai Z.-Y.
    [J]. Journal of China Universities of Posts and Telecommunications, 2011, 18 (01): : 121 - 128
  • [2] Engineering a differencing and compression data format
    Korn, DG
    Vo, KP
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE GENERAL TRACK, 2002, : 219 - 228
  • [3] FORMAT BASED DATA-COMPRESSION
    LYONS, NR
    [J]. DATA BASE, 1983, 14 (02): : 15 - 18
  • [4] Compression of FASTQ and SAM Format Sequencing Data
    Bonfield, James K.
    Mahoney, Matthew V.
    [J]. PLOS ONE, 2013, 8 (03):
  • [5] CLASSMODE - A NEW DATA FORMAT FOR REAL-TIME MULTIPARAMETER DATA-ANALYSIS AND DATA-COMPRESSION
    KEIJ, JF
    GROENEWEGEN, AC
    JONKER, RR
    SMITH, CR
    VISSER, JWM
    [J]. CYTOMETRY, 1995, 19 (01): : 92 - 96
  • [6] A new compression format for fiber tracking datasets
    Presseau, Caroline
    Jodoin, Pierre-Marc
    Houde, Jean-Christophe
    Descoteaux, Maxime
    [J]. NEUROIMAGE, 2015, 109 : 73 - 83
  • [7] COMPRESSION OF CONTINUOUS SPATIAL DATA IN THE RASTER DIGITAL FORMAT
    PLUMB, GA
    [J]. COMPUTERS & GEOSCIENCES, 1993, 19 (04) : 493 - 497
  • [8] A new format for polysomnography data
    Smith, J
    Johnson, J
    Schubert, J
    Widell, R
    [J]. SLEEP, 2005, 28 (11) : 1473 - 1473
  • [9] Evaluation of the new OASIS format for layout fill compression
    Chen, Y
    Kahng, AB
    Robins, G
    Zelikovsky, A
    Zheng, YH
    [J]. ICECS 2004: 11TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS, 2004, : 377 - 382
  • [10] An Approach to Compression of Genomic Data Based on Image File Format
    Martins, Juliano V.
    Kredens, Kelvin V.
    Dordall, Osmar B.
    Arruda, Paulo H. S.
    Borges, Andr P.
    Herai, Roberto H.
    Scalabrin, Edson E.
    Avila, Braulio C.
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 3274 - 3279