Learned FBF: Learning-Based Functional Bloom Filter for Key-Value Storage

被引:11
|
作者
Byun, Hayoung [1 ]
Lim, Hyesook [2 ]
机构
[1] Myongji Univ, Dept Elect Engn, Yongin 17058, South Korea
[2] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
基金
新加坡国家研究基金会;
关键词
Data structures; Data models; Programming; Memory management; Indexes; Task analysis; Neural networks; Key-value storage; functional Bloom filter; deep learning; search failure;
D O I
10.1109/TC.2021.3112079
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
As a challenging attempt to replace a traditional data structure with a learned model, this paper proposes a learned functional Bloom filter (L-FBF) for a key-value storage. The learned model in the proposed L-FBF learns the characteristics and the distribution of given data and classifies each input. It is shown through theoretical analysis that the L-FBF provides a lower search failure rate than a single FBF in the same memory size, while providing the same semantic guarantees. For model training, character-level neural networks are used with pretrained embeddings. In experiments, four types of different character-level neural networks are trained: a single gated recurrent unit (GRU), two GRUs, a single long short-term memory (LSTM), and a single one-dimensional convolutional neural network (1D-CNN). Experimental results prove the validity of theoretical results, and show that the L-FBF reduces the search failures by 82.8% to 83.9% when compared with a single FBF under the same amount of memory used.
引用
收藏
页码:1928 / 1938
页数:11
相关论文
共 50 条
  • [31] ArkDB: A Key-Value Engine for Scalable Cloud Storage Services
    Pang, Zhu
    Lu, Qingda
    Chen, Shuo
    Wang, Rui
    Xu, Yikang
    Wu, Jiesheng
    SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2021, : 2570 - 2583
  • [32] Indexing spatiotemporal trajectory data streams on key-value storage
    Zhao, Xiaofei
    Lam, Kam-Yiu
    Kuo, Tei-Wei
    COMPUTING, 2024, 106 (08) : 2707 - 2735
  • [33] A DHT Key-Value Storage System with Carrier Grade Performance
    Shi, Guangyu
    Chen, Jian
    Gong, Hao
    Fan, Lingyuan
    Xue, Haiqiang
    Lu, Qingming
    Liang, Liang
    EURO-PAR 2009: PARALLEL PROCESSING, PROCEEDINGS, 2009, 5704 : 361 - +
  • [34] A convergence of key-value storage systems from clouds to supercomputers
    Li, Tonglin
    Zhou, Xiaobing
    Wang, Ke
    Zhao, Dongfang
    Sadooghi, Iman
    Zhang, Zhao
    Raicu, Ioan
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (01): : 44 - 69
  • [35] Study on the key-value distributed storage system for cloud computing
    Sun, Y. (sy@zjvtit.edu.cn), 2013, Chinese Institute of Electronics (41):
  • [36] ShieldStore: Shielded In-memory Key-value Storage with SGX
    Kim, Taehoon
    Park, Joongun
    Woo, Jaewook
    Jeon, Seungheun
    Huh, Jaehyuk
    PROCEEDINGS OF THE FOURTEENTH EUROSYS CONFERENCE 2019 (EUROSYS '19), 2019,
  • [37] XStore: Fast RDMA-Based Ordered Key-Value Store Using Remote Learned Cache
    Wei, Xingda
    Chen, Rong
    Chen, Haibo
    Zang, Binyu
    ACM TRANSACTIONS ON STORAGE, 2021, 17 (03)
  • [38] HaLSM: A Hotspot-aware LSM-tree based Key-Value Storage Engine
    Zhang, Jianshun
    Wang, Fang
    Dong, Chao
    2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, : 179 - 186
  • [39] Differentiated Key-Value Storage Management for Balanced I/O Performance
    Li, Yongkun
    Liu, Zhen
    Lee, Patrick P. C.
    Wu, Jiayu
    Xu, Yinlong
    Wu, Yi
    Tang, Liu
    Liu, Qi
    Cui, Qiu
    PROCEEDINGS OF THE 2021 USENIX ANNUAL TECHNICAL CONFERENCE, 2021, : 673 - 687
  • [40] A Highly Scalable Key-value Storage System for Latency Sensitive Applications
    Wang, Qiang
    Tang, Feilong
    CISIS: 2009 INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS, VOLS 1 AND 2, 2009, : 537 - 542