Learned FBF: Learning-Based Functional Bloom Filter for Key-Value Storage

被引:11
|
作者
Byun, Hayoung [1 ]
Lim, Hyesook [2 ]
机构
[1] Myongji Univ, Dept Elect Engn, Yongin 17058, South Korea
[2] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
基金
新加坡国家研究基金会;
关键词
Data structures; Data models; Programming; Memory management; Indexes; Task analysis; Neural networks; Key-value storage; functional Bloom filter; deep learning; search failure;
D O I
10.1109/TC.2021.3112079
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
As a challenging attempt to replace a traditional data structure with a learned model, this paper proposes a learned functional Bloom filter (L-FBF) for a key-value storage. The learned model in the proposed L-FBF learns the characteristics and the distribution of given data and classifies each input. It is shown through theoretical analysis that the L-FBF provides a lower search failure rate than a single FBF in the same memory size, while providing the same semantic guarantees. For model training, character-level neural networks are used with pretrained embeddings. In experiments, four types of different character-level neural networks are trained: a single gated recurrent unit (GRU), two GRUs, a single long short-term memory (LSTM), and a single one-dimensional convolutional neural network (1D-CNN). Experimental results prove the validity of theoretical results, and show that the L-FBF reduces the search failures by 82.8% to 83.9% when compared with a single FBF under the same amount of memory used.
引用
收藏
页码:1928 / 1938
页数:11
相关论文
共 50 条
  • [41] Design and implementation of an efficient flushing scheme for cloud key-value storage
    Yongseok Son
    Heon Young Yeom
    Hyuck Han
    Cluster Computing, 2017, 20 : 3551 - 3563
  • [42] LevelStore: A large scale key-value store for deduplication storage system
    Lu, Y., 1600, Asian Network for Scientific Information (12):
  • [43] Optimization of the Key-Value Storage System Based on Fused User-Level I/O
    An Z.
    Zhang Y.
    Xing J.
    Huo Z.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (03): : 649 - 659
  • [44] Distributed and High Performance Big-File Cloud Storage Based On Key-Value Store
    Thanh Trung Nguyen
    Minh Hieu Nguyen
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2016, 4 (03) : 159 - 172
  • [45] PRISM: Optimizing Key-Value Store for Modern Heterogeneous Storage Devices
    Song, Yongju
    Kim, Wook-Hee
    Monga, Sumit Kumar
    Min, Changwoo
    Eom, Young Ik
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, VOL 2, ASPLOS 2023, 2023, : 588 - 602
  • [46] Improving Performance of Cloud Key-value Storage Using Flushing Optimization
    Son, Yongseok
    Kang, Hara
    Han, Hyuck
    Yeom, Heon Young
    2016 IEEE 1ST INTERNATIONAL WORKSHOPS ON FOUNDATIONS AND APPLICATIONS OF SELF* SYSTEMS (FAS*W), 2016, : 42 - 47
  • [47] A Flexible QoS Fortified Distributed Key-Value Storage System for the Cloud
    Li, Tonglin
    Wang, Ke
    Zhao, Dongfang
    Qiao, Kan
    Sadooghi, Iman
    Zhou, Xiaobing
    Raicu, Ioan
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 515 - 522
  • [48] A Consistent Replica Selection Approach for Distributed Key-Value Storage System
    Nwe, Thazin
    Yee, Tin Tin
    Htoon, Ei Chaw
    Nakamura, Junya
    2019 INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION TECHNOLOGIES (ICAIT), 2019, : 114 - 119
  • [49] Atlas: Baidu's Key-value Storage System for Cloud Data
    Lai, Chunbo
    Jiang, Song
    Yang, Liqiong
    Lin, Shiding
    Sun, Guangyu
    Hou, Zhenyu
    Cui, Can
    Cong, Jason
    2015 31ST SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2015,
  • [50] An Efficient Memory-Mapped Key-Value Store for Flash Storage
    Papagiannis, Anastasios
    Saloustros, Giorgos
    Gonzalez-Ferez, Pilar
    Bilas, Angelos
    PROCEEDINGS OF THE 2018 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '18), 2018, : 490 - 502