Fast Locality-Sensitive Hashing Frameworks for Approximate Near Neighbor Search

被引:9
|
作者
Christiani, Tobias [1 ]
机构
[1] Maersk Line, Copenhagen, Denmark
基金
欧洲研究理事会;
关键词
ALGORITHMS;
D O I
10.1007/978-3-030-32047-8_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Indyk-Motwani Locality-Sensitive Hashing (LSH) framework (STOC 1998) is a general technique for constructing a data structure to answer approximate near neighbor queries by using a distribution H over locality-sensitive hash functions that partition space. For a collection of n points, after preprocessing, the query time is dominated by O(n(rho) log n) evaluations of hash functions from H and O(n(rho)) hash table lookups and distance computations where rho is an element of(0, 1) is determined by the locality-sensitivity properties of H. It follows from a recent result by Dahlgaard et al. (FOCS 2017) that the number of locality-sensitive hash functions can be reduced to O(log(2) n), leaving the query time to be dominated by O(n(rho)) distance computations and O(n(rho) log n) additional word-RAM operations. We state this result as a general framework and provide a simpler analysis showing that the number of lookups and distance computations closely match the Indyk-Motwani framework. Using ideas from another locality-sensitive hashing framework by Andoni and Indyk (SODA 2006) we are able to reduce the number of additional word-RAM operations to O(n(rho)).
引用
收藏
页码:3 / 17
页数:15
相关论文
共 50 条
  • [42] Anomaly detection based on Nearest Neighbor search with Locality-Sensitive B-tree
    Shen, Maying
    Jiang, Xinghao
    Sun, Tanfeng
    [J]. NEUROCOMPUTING, 2018, 289 : 55 - 67
  • [43] Toward an Effective Locality-Sensitive Hashing Search for WMSNs Based on the Neighborhood Rough Set Approach
    Xiao, Ruliang
    Liu, Shirong
    Li, Yiqi
    Ni, Youcong
    Du, Xin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (11): : 10985 - 10995
  • [44] A semantic search model based on locality-sensitive hashing in mobile P2P
    Hou, Xiang-Song
    Yuan-da, Cao
    Guan, Zhi-tao
    [J]. 10TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY, VOLS I-III: INNOVATIONS TOWARD FUTURE NETWORKS AND SERVICES, 2008, : 1635 - +
  • [45] Digital Watermarks for Videos Based on a Locality-Sensitive Hashing Algorithm
    Sun, Yajuan
    Srivastava, Gautam
    [J]. MOBILE NETWORKS & APPLICATIONS, 2023, 28 (05): : 1724 - 1737
  • [46] Frequent-Itemset Mining Using Locality-Sensitive Hashing
    Bera, Debajyoti
    Pratap, Rameshwar
    [J]. COMPUTING AND COMBINATORICS, COCOON 2016, 2016, 9797 : 143 - 155
  • [47] Locality-Sensitive Hashing for Finding Nearest Neighbors in Probability Distributions
    Tang, Yi-Kun
    Mao, Xian-Ling
    Hao, Yi-Jing
    Xu, Cheng
    Huang, Heyan
    [J]. SOCIAL MEDIA PROCESSING, SMP 2017, 2017, 774 : 3 - 15
  • [48] A Scalable ECG Identification System Based on Locality-Sensitive Hashing
    Chu, Hui-Yu
    Lin, Tzu-Yun
    Lee, Song-Hong
    Chiu, Jui-Kun
    Nien, Cing-Ping
    Wu, Shun-Chi
    [J]. 2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [49] Similar Pair Identification using Locality-Sensitive Hashing Technique
    Lee, Kyung Mi
    Lee, Keon Myung
    [J]. 6TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS, AND THE 13TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS, 2012, : 2117 - 2119
  • [50] CONSULT: accurate contamination removal using locality-sensitive hashing
    Rachtman, Eleonora
    Bafna, Vineet
    Mirarab, Siavash
    [J]. NAR GENOMICS AND BIOINFORMATICS, 2021, 3 (03)