PA-LBF: Prefix-Based and Adaptive Learned Bloom Filter for Spatial Data

被引:1
|
作者
Zeng, Meng [1 ,2 ]
Zou, Beiji [1 ,2 ]
Kui, Xiaoyan [1 ]
Zhu, Chengzhang [2 ,3 ]
Xiao, Ling [1 ,2 ]
Chen, Zhi [1 ,2 ]
Du, Jingyu [4 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Mobile Hlth Minist Educ China Mobile Joint Lab, Changsha 410083, Peoples R China
[3] Cent South Univ, Coll Literature & Journalism, Changsha 410083, Peoples R China
[4] Shenzhen Polytech, Sch Artificial Intelligence, Shenzhen 518055, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Adaptive filters - Data structures - Learning systems - Query processing;
D O I
10.1155/2023/4970776
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The recently proposed learned bloom filter (LBF) opens a new perspective on how to reconstruct bloom filters with machine learning. However, the LBF has a massive time cost and does not apply to multidimensional spatial data. In this paper, we propose a prefix-based and adaptive learned bloom filter (PA-LBF) for spatial data, which efficiently supports the insertion and deletion. The proposed PA-LBF is divided into three parts: (1) the prefix-based classification. The Z-order space-filling curve is used to extract data, prefix it, and classify it. (2) The adaptive learning process. The multiple independent adaptive sub-LBFs are designed to train the suffixes of data, combined with part 1, to reduce the false positive rate (FPR), query, and learning process time consumption. (3) The backup filter uses CBF. Two kinds of backup CBF are constructed to meet the situation of different insertion and deletion frequencies. Experimental results prove the validity of the theory and show that the PA-LBF reduces the FPR by 84.87%, 79.53%, and 43.01% with the same memory usage compared with the LBF on three real-world spatial datasets. Moreover, the time consumption of PA-LBF can be reduced to 5x and 2.05x that of the LBF on the query and learning process, respectively.
引用
下载
收藏
页数:19
相关论文
共 50 条
  • [1] A Learned Prefix Bloom Filter for Spatial Data
    Zou, Beiji
    Zeng, Meng
    Zhu, Chengzhang
    Xiao, Ling
    Chen, Zhi
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2022, PT I, 2022, 13426 : 336 - 350
  • [2] Scalable Name Lookup with Adaptive Prefix Bloom Filter for Named Data Networking
    Quan, Wei
    Xu, Changqiao
    Guan, Jianfeng
    Zhang, Hongke
    Grieco, Luigi Alfredo
    IEEE COMMUNICATIONS LETTERS, 2014, 18 (01) : 102 - 105
  • [3] Efficient Access Control of Large Scale RDF Data Using Prefix-Based Labeling
    Ahn, Jinhyun
    Im, Dong-Hyuk
    IEEE ACCESS, 2020, 8 : 122405 - 122412
  • [4] On predictable large-scale data delivery in prefix-based virtualized content networks
    Waehlisch, Matthias
    Schmidt, Thomas C.
    Wittenburg, Georg
    COMPUTER NETWORKS, 2011, 55 (18) : 4086 - 4100
  • [5] A Bloom Filter-Based Data Deduplication for Big Data
    Podder, Shrayasi
    Mukherjee, S.
    ADVANCES IN DATA AND INFORMATION SCIENCES, VOL 1, 2018, 38 : 161 - 168
  • [6] Spatial Bloom Filter in Named Data Networking: a Memory Efficient Solution
    Berto, Filippo
    Calderoni, Luca
    Conti, Mauro
    Losiouk, Eleonora
    PROCEEDINGS OF THE 35TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING (SAC'20), 2020, : 274 - 277
  • [7] An Approach for Searching on Encrypted Data Based on Bloom Filter
    Yao Hanbing
    Xiang Dong
    Peng Dewei
    Huang Jing
    2012 11TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS TO BUSINESS, ENGINEERING & SCIENCE (DCABES), 2012, : 301 - 304
  • [8] Encrypted Data Retrieval Scheme Based on Bloom Filter
    Mu, Yicheng
    Yao, Hanbing
    2019 18TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2019), 2019, : 249 - 252
  • [9] A Partition Based Bloom Filter For Fastest Data Search
    Pandeeswari, P.
    Murugeswari, S.
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2016, : 294 - 297
  • [10] Adaptive Compression Trie Based Bloom Filter: Request Filter forN DN Content Store
    Zhang, Ran
    Liu, Jiang
    Huang, Tao
    Pan, Tian
    Wu, Lixuan
    IEEE ACCESS, 2017, 5 : 23647 - 23656