Communication-Efficient Distributed Skyline Computation

被引:6
|
作者
Zhang, Haoyu [1 ]
Zhang, Qin [1 ]
机构
[1] Indiana Univ Bloomington, Bloomington, IN 47408 USA
关键词
QUERIES;
D O I
10.1145/3132847.3132927
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we study skyline queries in the distributed computational model, where we have s remote sites and a central coordinator; each site holds a piece of data, and the coordinator wants to compute the skyline of the union of the s datasets. The computation is in terms of rounds, and the goal is to minimize both the total communication cost and the round cost. We first give an algorithm with a small communication cost but potentially a large round cost; we show information-theoretically that the communication cost is optimal even if we allow an infinite number of communication rounds. We next give algorithms with smooth communication-round tradeoffs. We also show a strong lower bound for the communication cost if we can only use one round of communication. Finally, we demonstrate the superiority of our algorithms over existing ones by an extensive set of experiments on both synthetic and real world datasets.
引用
收藏
页码:437 / 446
页数:10
相关论文
共 50 条
  • [1] Communication-Efficient Computation on Distributed Noisy Datasets
    Zhang, Qin
    [J]. SPAA'15: PROCEEDINGS OF THE 27TH ACM SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES, 2015, : 313 - 322
  • [2] EVALUATION OF COMMUNICATION AND COMPUTATION EFFICIENT ALGORITHMS FOR DISTRIBUTED SKYLINE QUERIES
    Sunitha, T.
    Indu, L.
    [J]. 2013 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2013, : 201 - 206
  • [3] Skyline View: Efficient Distributed Subspace Skyline Computation
    Kim, Jinhan
    Lee, Jongwuk
    Hwang, Seung-won
    [J]. DATA WAREHOUSING AND KNOWLEDGE DISCOVERY, PROCEEDINGS, 2009, 5691 : 312 - 324
  • [4] Efficient and Adaptive Distributed Skyline Computation
    Valkanas, George
    Papadopoulos, Apostolos N.
    [J]. SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2010, 6187 : 24 - +
  • [5] Supporting efficient distributed skyline computation using skyline views
    Lee, Jongwuk
    Kim, Jinhan
    Hwang, Seung-won
    [J]. INFORMATION SCIENCES, 2012, 194 : 24 - 37
  • [6] Communication-Efficient Distributed Eigenspace Estimation
    Charisopoulos, Vasileios
    Benson, Austin R.
    Damle, Anil
    [J]. SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2021, 3 (04): : 1067 - 1092
  • [7] FAST AND COMMUNICATION-EFFICIENT DISTRIBUTED PCA
    Gang, Arpita
    Raja, Haroon
    Bajwa, Waheed U.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7450 - 7454
  • [8] Communication-efficient distributed oblivious transfer
    Beimel, Amos
    Chee, Yeow Meng
    Wang, Huaxiong
    Zhang, Liang Feng
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2012, 78 (04) : 1142 - 1157
  • [9] Communication-Efficient Distributed Statistical Inference
    Jordan, Michael I.
    Lee, Jason D.
    Yang, Yun
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (526) : 668 - 681
  • [10] Communication-Efficient Distributed Learning: An Overview
    Cao, Xuanyu
    Basar, Tamer
    Diggavi, Suhas
    Eldar, Yonina C.
    Letaief, Khaled B.
    Poor, H. Vincent
    Zhang, Junshan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 851 - 873