Lossy Scientific Data Compression With SPERR

被引：7
|
作者：
Li, Shaomeng [1 ]
Lindstrom, Peter [2 ]
Clyne, John [1 ]
机构：
[1] Natl Ctr Atmospher Res, Boulder, CO 80305 USA
[2] Lawrence Livermore Natl Lab, Lawrence, KS USA
来源：
2023 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM, IPDPS | 2023年
基金：
美国国家科学基金会;
关键词：
MULTILEVEL TECHNIQUES; IMAGE COMPRESSION; EFFICIENT; REDUCTION; QUANTIZATION;
D O I：
10.1109/IPDPS54959.2023.00104
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
As the need for data reduction in high-performance computing (HPC) continues to grow, we introduce a new and highly effective tool to help achieve this goal-SPERR. SPERR is a versatile lossy compressor for structured scientific data; it is built on top of an advanced wavelet compression algorithm, SPECK, and provides additional capabilities valued in HPC environments. These capabilities include parallel execution for large volumes and a compression mode that satisfies a maximum point-wise error tolerance. Evaluation shows that in most settings SPERR achieves the best rate-distortion trade-off among current popular lossy scientific data compressors.
引用
收藏
页码：1007 / 1017
页数：11
相关论文
共 50 条
  • [31] Evaluating Lossy Compression on Climate Data
    Huebbe, Nathanael
    Wegener, Al
    Kunkel, Julian Martin
    Ling, Yi
    Ludwig, Thomas
    SUPERCOMPUTING (ISC 2013), 2013, 7905 : 343 - 356
  • [32] Lossy compression of acoustic backscatter data
    Goldschneider, JR
    Bruce, AG
    Percival, DB
    DETECTION AND REMEDIATION TECHNOLOGIES FOR MINES AND MINELIKE TARGETS II, 1997, 3079 : 213 - 224
  • [33] WAVELET LOSSY COMPRESSION OF RANDOM DATA
    Andrecut, M.
    INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2009, 20 (01): : 109 - 116
  • [34] WAVESZ: A Hardware-Algorithm Co-Design of Efficient Lossy Compression for Scientific Data
    Tian, Jiannan
    Di, Sheng
    Zhang, Chengming
    Liang, Xin
    Jin, Sian
    Cheng, Dazhao
    Tao, Dingwen
    Cappello, Franck
    PROCEEDINGS OF THE 25TH ACM SIGPLAN SYMPOSIUM ON PRINCIPLES AND PRACTICE OF PARALLEL PROGRAMMING (PPOPP '20), 2020, : 74 - 88
  • [35] Ultrafast Error-Bounded Lossy Compression for Scientific Datasets
    Yu, Xiaodong
    Di, Sheng
    Zhao, Kai
    Tian, Jiannan
    Tao, Dingwen
    Liang, Xin
    Cappello, Franck
    PROCEEDINGS OF THE 31ST INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, HPDC 2022, 2022, : 159 - 171
  • [36] Distributed Binary Detection With Lossy Data Compression
    Katz, Gil
    Piantanida, Pablo
    Debbah, Merouane
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (08) : 5207 - 5227
  • [37] Optimal algorithm for lossy vector data compression
    Kolesnikov, Alexander
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2007, 4633 : 761 - 771
  • [38] cuSZ: An Efficient GPU-Based Error-Bounded Lossy Compression Framework for Scientific Data
    Tian, Jiannan
    Di, Sheng
    Zhao, Kai
    Rivera, Cody
    Fulp, Megan Hickman
    Underwood, Robert
    Jin, Sian
    Liang, Xin
    Calhoun, Jon
    Tao, Dingwen
    Cappello, Franck
    PACT '20: PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES, 2020, : 3 - 15
  • [39] Lossy compression of haptic data by using DCT
    Tanaka H.
    Ohnishi K.
    IEEJ Transactions on Industry Applications, 2010, 130 (08) : 945 - 952+2
  • [40] Lossy Compression of Weak-Lensing Data
    Vanderveld, R. Ali
    Bernstein, Gary M.
    Stoughton, Chris
    Rhodes, Jason
    Massey, Richard
    Johnston, David
    Dobke, Benjamin M.
    PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC, 2011, 123 (906) : 996 - 1003
12345