Fast Filtering for Nearest Neighbor Search by Sketch Enumeration Without Using Matching

被引:2
|
作者
Higuchi, Naoya [1 ]
Imamura, Yasunobu [2 ]
Kuboyama, Tetsuji [3 ]
Hirata, Kouichi [1 ]
Shinohara, Takeshi [1 ]
机构
[1] Kyushu Inst Technol, Kawazu 680-4, Iizuka, Fukuoka 8208502, Japan
[2] Syst Studio COLUN, Kokubu Machi 221-2, Kurume, Fukuoka 8390863, Japan
[3] Gakushuin Univ, Toshima Ku, Mejiro 1-5-1, Tokyo 1718588, Japan
关键词
Similarity search; Nearest neighbor search; Sketch enumeration; Ball partitioning; Hamming distance; Dimension reduction;
D O I
10.1007/978-3-030-35288-2_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A sketch is a lossy compression of high-dimensional data into compact bit strings such as locality sensitive hash. In general, k nearest neighbor search using sketch consists of the following two stages. The first stage narrows down the top K candidates, for some K = k, using a priority measure of sketch as a filter. The second stage selects the k nearest objects from K candidates. In this paper, we discuss the search algorithms using fast filtering by sketch enumeration without using matching. Surprisingly, the search performance is rather improved by the proposed method when narrow sketches with smaller number of bits such as 16-bits than the conventional ones are used. Furthermore, we compare the search efficiency by sketches of various widths for several databases, which have different numbers of objects and dimensionalities. Then, we can observe that wider sketches are appropriate for larger databases, while narrower sketches are appropriate for higher dimension.
引用
收藏
页码:240 / 252
页数:13
相关论文
共 50 条
  • [1] Fast Nearest Neighbor Search with Narrow 16-bit Sketch
    Higuchi, Naoya
    Imamura, Yasunobu
    Kuboyama, Tetsuji
    Hirata, Kouichi
    Shinohara, Takeshi
    [J]. ICPRAM: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2019, : 540 - 547
  • [2] Fast k Nearest Neighbor Search using GPU
    Garcia, Vincent
    Debreuve, Eric
    Barlaud, Michel
    [J]. 2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1107 - 1112
  • [3] Fast Nearest Neighbor Search with Keywords
    Tao, Yufei
    Sheng, Cheng
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (04) : 878 - 888
  • [4] Feature matching algorithm based on KAZE and fast approximate nearest neighbor search
    Cai, Ze-Ping
    Xiao, De-Gui
    [J]. PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SERVICE SYSTEM (CSSS), 2014, 109 : 270 - 273
  • [5] Fast nearest neighbor search algorithm using the cache technique
    Choi, Wonseok
    Oh, Seyoung
    [J]. ADVANCED ROBOTICS, 2013, 27 (15) : 1175 - 1187
  • [6] Feature Matching Method Based on SURF and Fast Library for Approximate Nearest Neighbor Search
    Wang Beiyi
    Zhang Xiaohong
    Wang Weibing
    [J]. INTEGRATED FERROELECTRICS, 2021, 218 (01) : 147 - 154
  • [7] A fast nearest neighbor search algorithm by filtration
    Cha, SH
    Srihari, SN
    [J]. PATTERN RECOGNITION, 2002, 35 (02) : 515 - 525
  • [8] Fast nearest neighbor search on road networks
    Hu, Haibo
    Lee, Dik Lun
    Xu, Jianliang
    [J]. ADVANCES IN DATABASE TECHNOLOGY - EDBT 2006, 2006, 3896 : 186 - 203
  • [9] Fast Shape-Based Nearest-Neighbor Search for Brain MRIs Using Hierarchical Feature Matching
    Zhu, Peihong
    Awate, Suyash P.
    Gerber, Samuel
    Whitaker, Ross
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION (MICCAI 2011), PT II, 2011, 6892 : 484 - 491
  • [10] Fast Nearest Neighbor Search with keyword using Compressed Inverted Index
    Shinde, Snehal Bankatrao
    Chavan, M. K.
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2016, : 546 - 550