MiniCrypt: Reconciling Encryption and Compression for Big Data Stores

被引:9
|
作者
Zheng, Wenting [1 ]
Li, Frank [1 ]
Popa, Raluca Ada [1 ]
Stoica, Ion [1 ]
Agarwal, Rachit [2 ]
机构
[1] Univ Calif Berkeley, Berkeley, CA 94720 USA
[2] Cornell Univ, Ithaca, NY 14853 USA
基金
美国国家科学基金会;
关键词
D O I
10.1145/3064176.3064184
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We propose MiniCrypt, the first key-value store that reconciles encryption and compression without compromising performance. At the core of MiniCrypt is an observation on data compressibility trends in key-value stores, which enables grouping key-value pairs into small key packs, together with a set of distributed systems techniques for retrieving, updating, merging and splitting encrypted packs. Our evaluation shows that MiniCrypt compresses data by as much as 4 times with respect to the vanilla key-value store, and can increase the server's throughput by up to two orders of magnitude by fitting more data in main memory.
引用
收藏
页码:191 / 204
页数:14
相关论文
共 50 条
  • [1] Enabling Compressed Encryption for Cloud Based Big Data Stores
    Zhang, Meng
    Qi, Saiyu
    Miao, Meixia
    Zhang, Fuyou
    [J]. CRYPTOLOGY AND NETWORK SECURITY (CANS 2019), 2019, 11829 : 270 - 287
  • [2] Large-scale electrophysiology: Acquisition, compression, encryption, and storage of big data
    Brinkmann, Benjamin H.
    Bower, Mark R.
    Stengel, Keith A.
    Worrell, Gregory A.
    Stead, Matt
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2009, 180 (01) : 185 - 192
  • [3] Reconciling data compression and Kolmogorov complexity
    Bienvenu, Laurent
    Merkle, Wolfgang
    [J]. AUTOMATA, LANGUAGES AND PROGRAMMING, PROCEEDINGS, 2007, 4596 : 643 - +
  • [4] BigCrypt for Big Data Encryption
    Al Mamun, Abdullah
    Salah, Khaled
    Al-Maadeed, Somaya
    Sheltami, Tarek R.
    [J]. 2017 FOURTH INTERNATIONAL CONFERENCE ON SOFTWARE DEFINED SYSTEMS (SDS), 2017, : 93 - 99
  • [5] Simultaneous data compression and encryption
    Wang, CE
    [J]. SAM'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON SECURITY AND MANAGEMENT, VOLS 1 AND 2, 2003, : 558 - 563
  • [6] SURVEY OF DATA PARTITIONING ALGORITHMS FOR BIG DATA STORES
    Phansalkar, Shraddha
    Ahirrao, Swati
    [J]. 2016 FOURTH INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (PDGC), 2016, : 163 - 168
  • [7] Big Database Stores A review on various big data datastores
    George, Koshy
    Mathew, Tessy
    [J]. 2015 International Conference on Green Computing and Internet of Things (ICGCIoT), 2015, : 567 - 573
  • [8] From Minicrypt to Obfustopia via Private-Key Functional Encryption
    Komargodski, Ilan
    Segev, Gil
    [J]. ADVANCES IN CRYPTOLOGY - EUROCRYPT 2017, PT I, 2017, 10210 : 122 - 151
  • [9] Data hiding in encryption–compression domain
    O. P. Singh
    A. K. Singh
    [J]. Complex & Intelligent Systems, 2023, 9 : 2759 - 2772
  • [10] Autosophy data/image compression and encryption
    Holtz, K
    Holtz, E
    Kalienky, D
    [J]. MATHEMATICS OF DATA/IMAGE CODING, COMPRESSION, AND ENCRYPTION VII, WITH APPLICATIONS, 2004, 5561 : 25 - 38