An enhanced parallel processing algorithm based on TOP-K decomposition of hypercube model

被引:0
|
作者
Zhang Q. [1 ,2 ]
Feng Y. [1 ]
Qiang B.-H. [3 ,4 ]
Li Y. [2 ]
机构
[1] Chongqing University, Chongqing
[2] Xuchang University, Xuchang
[3] Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin
[4] Guangxi Key Laboratory of Optoelectronic Information Processing, Guilin University of Electronic Technology, Guilin
基金
中国国家自然科学基金;
关键词
Hypercube model; Parallel processing; TOP-K decomposition;
D O I
10.1504/IJADS.2022.121557
中图分类号
学科分类号
摘要
Parallel processing technology has been widely used in many fields. We will discuss the technology of large-scale data parallel computing based on network. The parallel processing method based on hypercube model could divide large-scale data into a large number of sub-datasets, which will be distributed to each processing unit. But empty hypercube units existed because of uneven segmentation. To solve this question, an enhanced parallel processing algorithm based on TOP-K (it is equal to selecting the kth data from the ordered data) decomposition of hypercube model was proposed to evenly divide large-scale data in parallel processing. Experiment result shows that the proposed algorithm has some enhancement on time complexity, scalability and speedup in contrast with the parallel processing method based on hypercube model. Copyright © 2022 Inderscience Enterprises Ltd.
引用
收藏
页码:143 / 155
页数:12
相关论文
共 50 条
  • [1] A Top-K Retrieval algorithm based on a decomposition of ranking functions
    Madrid, Nicolas
    Rusnok, Pavel
    INFORMATION SCIENCES, 2019, 474 : 136 - 153
  • [2] TKSimGPU: A Parallel Top-K Trajectory Similarity Query Processing Algorithm for GPGPUs
    Leal, Eleazar
    Gruenwald, Le
    Zhang, Jianting
    You, Simin
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 461 - 469
  • [3] Parallel and Distributed Processing of Reverse Top-k Queries
    Nikitopoulos, Panagiotis
    Sfyris, Georgios A.
    Vlachou, Akrivi
    Doulkeridis, Christos
    Telelis, Orestis
    2019 IEEE 35TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2019), 2019, : 1586 - 1589
  • [4] Top-k Algorithm Based on Extraction
    Li, Lingjuan
    Zeng, Xue
    Lu, Guoyu
    PROCEEDINGS OF THE 2011 2ND INTERNATIONAL CONGRESS ON COMPUTER APPLICATIONS AND COMPUTATIONAL SCIENCE, VOL 1, 2012, 144 : 113 - +
  • [5] A top-k spatial join querying processing algorithm based on spark
    Qiao, Baiyou
    Hu, Bing
    Zhu, Junhai
    Wu, Gang
    Giraud-Carrier, Christophe
    Wang, Guoren
    INFORMATION SYSTEMS, 2020, 87
  • [6] Pruning techniques for parallel processing of reverse top-k queries
    Panagiotis Nikitopoulos
    Georgios A. Sfyris
    Akrivi Vlachou
    Christos Doulkeridis
    Orestis Telelis
    Distributed and Parallel Databases, 2021, 39 : 169 - 199
  • [7] Efficient Top-K Query Processing on Massively Parallel Hardware
    Shanbhag, Anil
    Pirk, Holger
    Madden, Samuel
    SIGMOD'18: PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2018, : 1557 - 1570
  • [8] Pruning techniques for parallel processing of reverse top-k queries
    Nikitopoulos, Panagiotis
    Sfyris, Georgios A.
    Vlachou, Akrivi
    Doulkeridis, Christos
    Telelis, Orestis
    DISTRIBUTED AND PARALLEL DATABASES, 2021, 39 (01) : 169 - 199
  • [9] Multi-user Preferences Based Top-k Query Processing Algorithm
    Wu, Yunlong
    Liu, Guohua
    Liu, Yuanyuan
    2014 TENTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2014, : 69 - 73
  • [10] Parallel Top-k Query Processing on Uncertain Strings Using MapReduce
    Xu, Hui
    Ding, Xiaofeng
    Jin, Hai
    Jiang, Wenbin
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2015, PT II, 2015, 9050 : 89 - 103