Indexing Metric Spaces for Exact Similarity Search

被引:15
|
作者
Chen, Lu [1 ]
Gao, Yunjun [1 ]
Song, Xuan [1 ]
Li, Zheng [1 ]
Zhu, Yifan [1 ]
Miao, Xiaoye [2 ]
Jensen, Christian S. [3 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, 38 Zheda Rd, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Ctr Data Sci, 86 Yuhangtang Rd, Hangzhou 310058, Peoples R China
[3] Aalborg Univ, Dept Comp Sci, Selma Lagerlofs Vej 300, DK-9220 Aalborg, Denmark
关键词
Metric spaces; indexing and querying; metric similarity search; NEAREST NEIGHBOR SEARCH; ACCESS METHODS; TREE; ALGORITHM; EFFICIENT; DISTANCE; RETRIEVAL; QUERIES; PERFORMANCE; SELECTION;
D O I
10.1145/3534963
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
With the continued digitization of societal processes, we are seeing an explosion in available data. This is referred to as big data. In a research setting, three aspects of the data are often viewed as the main sources of challenges when attempting to enable value creation from big data: volume, velocity, and variety. Many studies address volume or velocity, while fewer studies concern the variety. Metric spaces are ideal for addressing variety because they can accommodate any data as long as it can be equipped with a distance notion that satisfies the triangle inequality. To accelerate search in metric spaces, a collection of indexing techniques for metric data have been proposed. However, existing surveys offer limited coverage, and a comprehensive empirical study exists has yet to be reported. We offer a comprehensive survey of existing metric indexes that support exact similarity search: we summarize existing partitioning, pruning, and validation techniques used by metric indexes to support exact similarity search; we provide the time and space complexity analyses of index construction; and we offer an empirical comparison of their query processing performance. Empirical studies are important when evaluating metric indexing performance, because performance can depend highly on the effectiveness of available pruning and validation as well as on the data distribution, which means that complexity analyses often offer limited insights. This article aims at revealing strengths and weaknesses of different indexing techniques to offer guidance on selecting an appropriate indexing technique for a given setting, and to provide directions for future research on metric indexing.
引用
收藏
页数:39
相关论文
共 50 条
  • [41] Quicker Similarity Joins in Metric Spaces
    Fredriksson, Kimmo
    Braithwaite, Billy
    SIMILARITY SEARCH AND APPLICATIONS (SISAP), 2013, 8199 : 127 - 140
  • [42] Distributed Similarity Queries in Metric Spaces
    Yang, Keyu
    Ding, Xin
    Zhang, Yuanliang
    Chen, Lu
    Zheng, Baihua
    Gao, Yunjun
    DATA SCIENCE AND ENGINEERING, 2019, 4 (02) : 93 - 108
  • [43] Similarity grid for searching in metric spaces
    Batko, M
    Gennaro, C
    Zezula, P
    PEER-TO-PEER, GRID, AND SERVICE -ORIENTATION IN DIGITAL LIBRARY ARCHITECTURES, 2005, 3664 : 25 - 44
  • [44] Optimal neighborhood indexing for protein similarity search
    Peterlongo, Pierre
    Noe, Laurent
    Lavenier, Dominique
    Nguyen, Van Hoa
    Kucherov, Gregory
    Giraud, Mathieu
    BMC BIOINFORMATICS, 2008, 9 (1)
  • [45] Database Similarity Join for Metric Spaces
    Silva, Yasin N.
    Pearson, Spencer S.
    Cheney, Jason A.
    SIMILARITY SEARCH AND APPLICATIONS (SISAP), 2013, 8199 : 266 - 279
  • [46] Rapid Dynamic Metric Indexing for Searching in Multi-Metric Spaces
    Liu, Lixia
    2ND INTERNATIONAL SYMPOSIUM ON COMPUTER NETWORK AND MULTIMEDIA TECHNOLOGY (CNMT 2010), VOLS 1 AND 2, 2010, : 398 - 401
  • [47] Adaptive similarity search in metric trees
    Yousri, Noha A.
    Ismail, Mohammed A.
    Kamel, Mohamed S.
    2007 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-8, 2007, : 2663 - +
  • [48] SPY-TEC: An efficient indexing method for similarity search in high-dimensional data spaces
    Lee, DH
    Kim, HJ
    DATA & KNOWLEDGE ENGINEERING, 2000, 34 (01) : 77 - 97
  • [49] Prefix Tree Indexing for Similarity Search and Similarity Joins on Genomic Data
    Rheinlaender, Astrid
    Knobloch, Martin
    Hochmuth, Nicky
    Leser, Ulf
    SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2010, 6187 : 519 - 536
  • [50] Adaptive Indexing in High-Dimensional Metric Spaces
    Lampropoulos, Konstantinos
    Zardbani, Fatemeh
    Mamoulis, Nikos
    Karras, Panagiotis
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (10): : 2525 - 2537