Learned FBF: Learning-Based Functional Bloom Filter for Key-Value Storage

被引:11
|
作者
Byun, Hayoung [1 ]
Lim, Hyesook [2 ]
机构
[1] Myongji Univ, Dept Elect Engn, Yongin 17058, South Korea
[2] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
基金
新加坡国家研究基金会;
关键词
Data structures; Data models; Programming; Memory management; Indexes; Task analysis; Neural networks; Key-value storage; functional Bloom filter; deep learning; search failure;
D O I
10.1109/TC.2021.3112079
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
As a challenging attempt to replace a traditional data structure with a learned model, this paper proposes a learned functional Bloom filter (L-FBF) for a key-value storage. The learned model in the proposed L-FBF learns the characteristics and the distribution of given data and classifies each input. It is shown through theoretical analysis that the L-FBF provides a lower search failure rate than a single FBF in the same memory size, while providing the same semantic guarantees. For model training, character-level neural networks are used with pretrained embeddings. In experiments, four types of different character-level neural networks are trained: a single gated recurrent unit (GRU), two GRUs, a single long short-term memory (LSTM), and a single one-dimensional convolutional neural network (1D-CNN). Experimental results prove the validity of theoretical results, and show that the L-FBF reduces the search failures by 82.8% to 83.9% when compared with a single FBF under the same amount of memory used.
引用
收藏
页码:1928 / 1938
页数:11
相关论文
共 50 条
  • [21] Private Set Intersection Based on Lightweight Oblivious Key-Value Storage Structure
    Jiang, Zhengtao
    Guo, Xiaoxuan
    Yu, Ting
    Zhou, Hanyu
    Wen, Jiaqi
    Wu, Zhengyang
    SYMMETRY-BASEL, 2023, 15 (11):
  • [22] Research of Massive Data Caching Strategy Based on Key-Value Storage Model
    Wang, Lei
    Chen, Gongxin
    Wang, Kun
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: BIG DATA AND MACHINE LEARNING TECHNIQUES, ISCIDE 2015, PT II, 2015, 9243 : 443 - 453
  • [23] LazyStore: Write-optimized Key-value Storage System Based on Hybrid Storage Architecture
    Du, Yun-Xiao
    Chen, Ke
    Shou, Li-Dan
    Jiang, Da-Wei
    Luo, Xin-Yuan
    Chen, Gang
    Ruan Jian Xue Bao/Journal of Software, 2025, 36 (02): : 805 - 829
  • [24] Research on Multicore Key-Value Storage System for Domain Name Storage
    Han, Luchao
    Guo, Zhichuan
    Zeng, Xuewen
    APPLIED SCIENCES-BASEL, 2021, 11 (16):
  • [25] SSD-BASED LSM-TREE KEY-VALUE STORAGE SYSTEM
    Yang Zining
    Jian Gang
    Hu Yu
    Zhang Siying
    Yang Yuanzhi
    2022 19TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2022,
  • [26] Experimental Framework for Searching Large RDF on GPUs based on Key-Value Storage
    Choksuchat, Chidchanok
    Chantrapornchai, Chantana
    2013 10TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (JCSSE), 2013, : 171 - 176
  • [27] Fast RDMA-based Ordered Key-Value Store using Remote Learned Cache
    Wei, Xingda
    Chen, Rong
    Chen, Haibo
    PROCEEDINGS OF THE 14TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDI '20), 2020, : 117 - 135
  • [28] InK: In-Kernel Key-Value Storage with Persistent Memory
    Ha, Minjong
    Kim, Sang-Hoon
    ELECTRONICS, 2020, 9 (11) : 1 - 22
  • [29] Hybrid Data Reliability for Emerging Key-Value Storage Devices
    Pitchumani, Rekha
    Kee, Yang-Suk
    PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2020, : 309 - 322
  • [30] The Design and Implementation of UniKV for Mixed Key-Value Storage Workloads
    Zhang, Qiang
    Li, Yongkun
    Lee, Patrick P. C.
    Xu, Yinlong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (11) : 11935 - 11949