Learned index for non-key queries

被引:0
|
作者
Zhu, Rui [1 ]
Wang, Hongzhi [1 ]
Xia, Sheng [1 ]
Zheng, Bo [2 ]
机构
[1] Harbin Inst Technol, Comp Sci & Technol, 92 Xidazhi St, Harbin 150000, Heilongjiang, Peoples R China
[2] CnosDB, Beijing 100000, Peoples R China
基金
中国国家自然科学基金;
关键词
Bloom filter; Learned index; Non-key query; Index;
D O I
10.1007/s10115-024-02233-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learned indexes have attracted a lot of interest lately due to their superior performance over conventional indexes. When there is a lot of data traffic, the learned index efficiently addresses the issue of the standard index's large memory usage. In this paper, we concentrate on a well-known learned index, the recursive model index (RMI). Since the machine learning model is unbiased while calculating, when there are too many non-key queried, the model will calculate the position of the key as if it were positive key, which wastes a lot of time on unnecessary calculations. To deal with this condition, we propose a hierarchical learned index structure based on Bloom filter named HBFdex. HBFdex can effectively prune non-keys, which means most non-key return in layer of BF before they get to machine learning model. By lowering the number of layers traversed by non-key and the time spent looking for non-key within the error bound that is provided by machine learning model, HBFdex decreases the average query time of learned index. We compare HBFdex with B-Tree and RMI, and the results prove that our new structure optimizes the performance of RMI in the case of non-key queries.
引用
收藏
页码:497 / 519
页数:23
相关论文
共 50 条
  • [41] NOVEL MUTATION IN A NON-KEY EXON OF DPB1 LEADS TO MISCALL OF ALLELES AS DETERMINED BY ANTIGEN-BINDING-REGION SEQUENCE
    Martin, Russell K.
    Kashi, Zahra M.
    Neville, RaeAnna M.
    Barner, Meagan
    DeKoning, Jenefer
    HUMAN IMMUNOLOGY, 2017, 78 : 120 - 120
  • [42] G-Learned Index: Enabling Efficient Learned Index on GPU
    Liu, Jiesong
    Zhang, Feng
    Lu, Lv
    Qi, Chang
    Guo, Xiaoguang
    Deng, Dong
    Li, Guoliang
    Zhang, Huanchen
    Zhai, Jidong
    Zhang, Hechen
    Chen, Yuxing
    Pan, Anqun
    Du, Xiaoyong
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (06) : 795 - 812
  • [43] Integrating gating and learned queries in audiovisual emotion recognition
    Zhang, Zaifang
    Guo, Qing
    Lu, Shunlu
    Su, Junyi
    Tang, Tao
    MULTIMEDIA SYSTEMS, 2024, 30 (06)
  • [44] Learned Index on GPU
    Zhong, Xun
    Zhang, Yong
    Chen, Yu
    Li, Chao
    Xing, Chunxiao
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW 2022), 2022, : 117 - 122
  • [45] Authenticated Index Structures for Aggregation Queries
    Li, Feifei
    Hadjieleftheriou, Marios
    Kollios, George
    Reyzin, Leonid
    ACM TRANSACTIONS ON INFORMATION AND SYSTEM SECURITY, 2010, 13 (04)
  • [46] An Extensible Notation for Spatiotemporal Index Queries
    Tsotras, Vassilis J.
    Jensen, Christian S.
    Snodgrass, Richard T.
    SIGMOD Record (ACM Special Interest Group on Management of Data), 1998, 27 (01): : 47 - 53
  • [47] Index Structures for Preference Database Queries
    Endres, Markus
    Weichmann, Felix
    FLEXIBLE QUERY ANSWERING SYSTEMS, FQAS 2017, 2017, 10333 : 137 - 149
  • [48] Three Queries about the HOMA Index
    Dobrowolski, Jan Cz
    ACS OMEGA, 2019, 4 (20): : 18699 - 18710
  • [49] Key concepts and lessons learned
    Miller, RA
    ON KINGDOM BUSINESS: TRANSFORMING MISSIONS THROUGH ENTREPRENEURIAL STRATEGIES, 2003, : 281 - +
  • [50] Public key encryption that allows PIR queries
    Boneh, Dan
    Kushilevitz, Eyal
    Ostrovsky, Rafail
    Skeith, William E., III
    ADVANCES IN CRYPTOLOGY - CRYPTO 2007, PROCEEDINGS, 2007, 4622 : 50 - +