Efficient and Robust Top-k Algorithms for Big Data IoT

被引:0
|
作者
Yang, Ruifan [1 ]
Zhou, Zheng [2 ]
Tseng, Lewis [2 ]
Alogaily, Moayad [3 ]
Boukerche, Azzedine [4 ]
机构
[1] Cornell Univ, Ithaca, NY 14850 USA
[2] Boston Coll, Boston, MA USA
[3] Al Ain Univ, Al Ain, U Arab Emirates
[4] Univ Ottawa, Ottawa, ON, Canada
关键词
IoT; Top-K query; fault-tolerance; distributed algorithms; approximate query;
D O I
10.1109/icc40277.2020.9148639
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Top-k considers as a technique to retrieve, from a hypothetically big data set, only the k (k >= 1) best (most relevant/important) candidates. Top-k query processing is a decisive necessity in various collaborative environments that comprise big data such as the Internet of Things (IoT) networks. Particularly, efficient top-k processing in large-scale distributed systems has shown a positively noticeable effect on their performance. This paper considers the distributed approximate top-k processing algorithms dedicated to the IoT-based networks and improve the accuracy of algorithms introduced previously. We then propose a safety-based fault-tolerance notation and contribute to improving a known algorithm in terms of accuracy. Our algorithms have been evaluated using simulation and real-world data and show superiority over conventional methods.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Ranking the big sky: efficient top-k skyline computation on massive data
    Xixian Han
    Bailing Wang
    Jianzhong Li
    Hong Gao
    [J]. Knowledge and Information Systems, 2019, 60 : 415 - 446
  • [2] Ranking the big sky: efficient top-k skyline computation on massive data
    Han, Xixian
    Wang, Bailing
    Li, Jianzhong
    Gao, Hong
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 60 (01) : 415 - 446
  • [3] Communication Efficient Algorithms for Top-k Selection Problems
    Huebschle-Schneider, Lorenz
    Sanders, Peter
    [J]. 2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2016), 2016, : 659 - 668
  • [4] Efficient Top-k Retrieval on Massive Data
    Han, Xixian
    Li, Jianzhong
    Gao, Hong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (10) : 2687 - 2699
  • [5] Efficient Top-k Retrieval on Massive Data
    Han, Xixian
    Li, Jianzhong
    Gao, Hong
    [J]. 2016 32ND IEEE INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2016, : 1496 - 1497
  • [6] Top-k Algorithms and Applications
    Das, Gautam
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PROCEEDINGS, 2009, 5463 : 789 - 792
  • [7] Parameterized top-K algorithms
    Chen, Jianer
    Kanj, Iyad A.
    Meng, Jie
    Xia, Ge
    Zhang, Fenghui
    [J]. THEORETICAL COMPUTER SCIENCE, 2013, 470 : 105 - 119
  • [8] Best position algorithms for efficient top-k query processing
    Akbarinia, Reza
    Pacitti, Esther
    Valduriez, Patrick
    [J]. INFORMATION SYSTEMS, 2011, 36 (06) : 973 - 989
  • [9] Efficient algorithms of mining top-k frequent closed itemsets
    Lan Yongjie
    Qiu Yong
    [J]. ICEMI 2007: PROCEEDINGS OF 2007 8TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS, VOL II, 2007, : 551 - 554
  • [10] Efficient Algorithms for Mining Top-K High Utility Itemsets
    Tseng, Vincent S.
    Wu, Cheng-Wei
    Fournier-Viger, Philippe
    Yu, Philip S.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) : 54 - 67