Accelerating the prediction-based lower triangular transform for data compression using Intel MIC

被引:0
|
作者
Wei, Shih-Chieh [1 ]
Huang, Bormin [2 ]
机构
[1] Tamkang Univ, Dept Informat Management, Tamsui 25137, Taiwan
[2] Univ Wisconsin, CIMSS SSEC, Madison, WI 53706 USA
关键词
prediction-based lower triangular transform; lossless data compression; Intel MIC architecture;
D O I
10.1117/12.2197301
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the same decorrelation and coding gain capabilities as the Karhunen-Loeve transform, the prediction-based lower triangular transform (PLT) can apply its perfect reconstruction property for lossless compression of ultraspectral sounder data. As the compression process requires computation of the covariance matrix, the LDU decomposition, and the transform kernel and coefficient matrices, it will be beneficial to introduce parallel processing technology in the PLT implementation. In this work, the recent Intel Many Integrated Core (MIC) architecture will be used which can exploit up to 60 cores with 4 hardware threads per core. Both threading and vectorization techniques will be explored for performance improvement. In our experiment, the total processing time of an AIRS granule can have a speedup of similar to 4.6x. With the offload mode, the MIC architecture provides a convenient and efficient tool for parallelization of the PLT compression scheme.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Concept and Analysis of Information Spaces to improve Prediction-Based Compression
    Cayoglu, Ugur
    Tristram, Frank
    Meyer, Joerg
    Kerzenmacher, Tobias
    Braesicke, Peter
    Streit, Achim
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 3392 - 3401
  • [32] Prediction-based realistic 3D model compression
    Shi, Yunhui
    Wen, Bo
    Ding, Wenpeng
    Qi, Na
    Yin, Baocai
    MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 70 (03) : 2125 - 2137
  • [33] A very low-complexity multi-resolution prediction-based wavelet transform method for medical image compression
    Nagaraj, N
    IEEE TENCON 2003: CONFERENCE ON CONVERGENT TECHNOLOGIES FOR THE ASIA-PACIFIC REGION, VOLS 1-4, 2003, : 525 - 528
  • [34] Networked Data Transaction in Mobile Networks: A Prediction-based Approach Using Auction
    Du, Jun
    Jiang, Chunxiao
    Gelenbe, Erol
    Han, Zhu
    Ren, Yong
    Guizani, Mohsen
    2018 14TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2018, : 201 - 206
  • [35] Prediction-based Physical Layer Base Station Switching using Imaging Data
    Nguyen, Khanh Nam
    Takizawa, Kenichi
    2023 JOINT EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS & 6G SUMMIT, EUCNC/6G SUMMIT, 2023, : 72 - 77
  • [36] A prediction-based adaptive reversible data embedding scheme
    Lee C.-F.
    Huang Y.-H.
    Chang C.-C.
    Liu T.-C.
    Journal of Software, 2011, 6 (09) : 1813 - 1820
  • [37] Prediction-Based Load Shedding for Burst Data Streams
    Maison, Rafal
    Zakrzewicz, Maciej
    BELL LABS TECHNICAL JOURNAL, 2011, 16 (01) : 121 - 132
  • [38] Prediction-Based Reversible Data Hiding with Content Characteristics
    Huang, Hsiang-Cheh
    Lin, Chuan-Chang
    Chang, Feng-Cheng
    2013 NINTH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING (IIH-MSP 2013), 2013, : 13 - 16
  • [39] A data cube model for prediction-based web prefetching
    Yang, Q
    Huang, JZX
    Ng, M
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2003, 20 (01) : 11 - 30
  • [40] PACM: A Prediction-based Auto-adaptive Compression Model for HDFS
    Wang, Ruijian
    Wang, Chao
    Zha, Li
    2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2016, : 1617 - 1626