FAST: Frequency-Aware Indexing for Spatio-Textual Data Streams

被引:17
|
作者
Mahmood, Ahmed R. [1 ]
Aly, Ahmed M. [2 ]
Aref, Walid G. [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
[2] Google Inc, Mountain View, CA USA
关键词
D O I
10.1109/ICDE.2018.00036
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications need to process massive streams of spatio-textual data in real-time against continuous spatio-textual queries. For example, in location-aware ad targeting publish/subscribe systems, it is required to disseminate millions of ads and promotions to millions of users based on the locations and textual profiles of users. In this paper, we study indexing of continuous spatio-textual queries. There exist several related spatio-textual indexes that typically integrate a spatial index with a textual index. However, these indexes usually have a high demand for main-memory and assume that the entire vocabulary of keywords is known in advance. Also, these indexes do not successfully capture the variations in the frequencies of keywords across different spatial regions and treat frequent and infrequent keywords in the same way. Moreover, existing indexes do not adapt to the changes in workload over space and time. For example, some keywords may be trending at certain times in certain locations and this may change as time passes. This affects the indexing and searching performance of existing indexes significantly. In this paper, we introduce FAST, a Frequency-Aware Spatio-Textual index for continuous spatio-textual queries. FAST is a main-memory index that requires up to one third of the memory needed by the state-of-the-art index. FAST does not assume prior knowledge of the entire vocabulary of indexed objects. FAST adaptively accounts for the difference in the frequencies of keywords within their corresponding spatial regions to automatically choose the best indexing approach that optimizes the insertion and search times. Extensive experimental evaluation using real and synthetic datasets demonstrates that FAST is up to 3x faster in search time and 5x faster in insertion time than the state-of-the-art indexes.
引用
收藏
页码:305 / 316
页数:12
相关论文
共 32 条
  • [31] An anti-noise block and frequency-aware framework in deep learning for formation resistivity prediction by transient electromagnetic data
    Zhang, Yongan
    Li, Jian
    Zhao, Junfeng
    Wang, Xuanran
    Sun, Youzhuang
    Li, Yizheng
    Chen, Yuntian
    Zhang, Dongxiao
    PHYSICS OF FLUIDS, 2025, 37 (04)
  • [32] Error-adaptive and time-aware maintenance of frequency counts over data streams
    Liu, Hongyan
    Lu, Ying
    Han, Jiawei
    He, Jun
    ADVANCES IN WEB-AGE INFORMATION MANAGEMENT, PROCEEDINGS, 2006, 4016 : 484 - 495