DASH: Data Aware Locality Sensitive Hashing

被引:0
|
作者
Tan, Zongyuan [1 ,3 ]
Wang, Hongya [1 ,2 ,3 ]
Du, Ming [1 ]
Zhang, Jie [1 ]
机构
[1] Donghua Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, State Key Lab Comp Architecture, ICT, Beijing, Peoples R China
[3] Shanghai Key Lab Comp Software Evaluating & Testi, Shanghai, Peoples R China
来源
关键词
LSH; ANNS; High dimensions; Data-dependent hashing; PRODUCT QUANTIZATION;
D O I
10.1007/978-3-031-25198-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Locality sensitive hashing (LSH) has been extensively employed to solve the problem of c-approximate nearest neighbor search (c-ANNS) in high-dimensional spaces. However, the search performance of LSH is degenerated with the number of data increasing. To this end, we propose an efficient method called Data Aware Sensitive Hashing (DASH) to deal with this drawback. DASH is the data-dependent hashing algorithm under considering the residual distance prior. DASH leverages this prior knowledge and provides theoretical guarantee for search results. Our experimental results with various datasets show that DASH achieves better search performance and the running time can reach up to about 4-40x speedups compared with other state-of-the-art methods.
引用
收藏
页码:85 / 100
页数:16
相关论文
共 50 条
  • [31] Using Locality-Sensitive Hashing for SVM Classification of Large Data Sets
    Gonzalez-Lima, Maria D.
    Ludena, Carenne C.
    MATHEMATICS, 2022, 10 (11)
  • [32] Locality Sensitive Hashing with Extended Differential Privacy
    Fernandes, Natasha
    Kawamoto, Yusuke
    Murakami, Takao
    COMPUTER SECURITY - ESORICS 2021, PT II, 2021, 12973 : 563 - 583
  • [33] On the Use of Locality Sensitive Hashing for Audio Following
    Guzman, Luis F.
    Camarena-Ibarrola, Antonio
    PROGRESS IN PATTERN RECOGNITION IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2014, 2014, 8827 : 175 - 182
  • [34] On Locality Sensitive Hashing for Sampling Extent Generators
    Codocedo, Victor
    My Thao Tang
    FOUNDATIONS OF INTELLIGENT SYSTEMS, ISMIS 2017, 2017, 10352 : 632 - 641
  • [35] Neural Locality Sensitive Hashing for Entity Blocking
    Wang, Runhui
    Kong, Luyang
    Tao, Yefan
    Borthwick, Andrew
    Golac, Davor
    Johnson, Henrik
    Hijazi, Shadie
    Deng, Dong
    Zhang, Yongfeng
    arXiv,
  • [36] Locality Sensitive Hashing with Extended Partitioning Boundaries
    Lee, Keon Myung
    MECHATRONICS AND INDUSTRIAL INFORMATICS, PTS 1-4, 2013, 321-324 : 804 - 807
  • [37] Bit Reduction for Locality-Sensitive Hashing
    Liu, Huawen
    Zhou, Wenhua
    Zhang, Hong
    Li, Gang
    Zhang, Shichao
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12470 - 12481
  • [38] Query-adaptative locality sensitive hashing
    Jegou, Herve
    Amsaleg, Laurent
    Schmid, Cordelia
    Gros, Patrick
    2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 825 - +
  • [39] A Locality Sensitive Hashing Approach for Conceptual Classification
    de Paula, Luciano B.
    Villaca, Rodolfo S.
    Magalhaes, Mauricio F.
    2010 IEEE FOURTH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2010), 2010, : 408 - 413
  • [40] Neural Locality Sensitive Hashing for Entity Blocking
    Wang, Runhui
    Kong, Luyang
    Tao, Yefan
    Borthwick, Andrew
    Golac, Davor
    Johnson, Henrik
    Hijazi, Shadie
    Deng, Dong
    Zhang, Yongfeng
    PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 887 - 895