Composite Quantization for Approximate Nearest Neighbor Search

被引:0
|
作者
Zhang, Ting [1 ,3 ]
Du, Chao [2 ,3 ]
Wang, Jingdong [3 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Tsinghua Univ, Beijing, Peoples R China
[3] Microsoft Res, Beijing, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel compact coding approach, composite quantization, for approximate nearest neighbor search. The idea is to use the composition of several elements selected from the dictionaries to accurately approximate a vector and to represent the vector by a short code composed of the indices of the selected elements. To efficiently compute the approximate distance of a query to a database vector using the short code, we introduce an extra constraint, constant inter-dictionary-element-product, resulting in that approximating the distance only using the distance of the query to each selected element is enough for nearest neighbor search. Experimental comparison with state-of-the-art algorithms over several benchmark datasets demonstrates the efficacy of the proposed approach.
引用
收藏
页码:838 / 846
页数:9
相关论文
共 50 条
  • [41] Approximate Nearest Neighbor Search Small World Approach
    Ponomarenko, Alexander
    Mal'kov, Yury
    Logvinov, Andrey
    Krylov, Vladimir
    ICT&A 2011/DEMSET 2011: INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES AND APPLICATIONS / INTERNATIONAL CONFERENCE ON DESIGN AND MODELING IN SCIENCE, EDUCATION, AND TECHNOLOGY, 2011, : 40 - 45
  • [42] Approximate Nearest Neighbor Search for Low Dimensional Queries
    Har-Peled, Sariel
    Kumar, Nirman
    PROCEEDINGS OF THE TWENTY-SECOND ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2011, : 854 - 867
  • [43] Fast spectral analysis for approximate nearest neighbor search
    Jing Wang
    Jie Shen
    Machine Learning, 2022, 111 : 2297 - 2322
  • [44] Approximate k-flat Nearest Neighbor Search
    Mulzer, Wolfgang
    Nguyen, Huy L.
    Seiferth, Paul
    Stein, Yannik
    STOC'15: PROCEEDINGS OF THE 2015 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2015, : 783 - 792
  • [45] Fast Approximate Nearest Neighbor Search via k-Diverse Nearest Neighbor Graph
    Xiao, Yan
    Guo, Jiafeng
    Lan, Yanyan
    Xu, Jun
    Cheng, Xueqi
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 8175 - 8176
  • [46] A Multilabel Classification Framework for Approximate Nearest Neighbor Search
    Hyvonen, Ville
    Jaasaari, Elias
    Roos, Teemu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [47] A Revisit of Hashing Algorithms for Approximate Nearest Neighbor Search
    Cai, Deng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (06) : 2337 - 2348
  • [48] SOAR: Improved Indexing for Approximate Nearest Neighbor Search
    Sun, Philip
    Simcha, David
    Dopson, Dave
    Guo, Ruiqi
    Kumar, Sanjiv
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [49] Fast spectral analysis for approximate nearest neighbor search
    Wang, Jing
    Shen, Jie
    MACHINE LEARNING, 2022, 111 (06) : 2297 - 2322
  • [50] Private Approximate Nearest Neighbor Search with Sublinear Communication
    Servan-Schreiber, Sacha
    Langowski, Simon
    Devadas, Srinivas
    43RD IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP 2022), 2022, : 911 - 929