Optimization Algorithm of Massive Data Query Based on JOIN

被引：0
|
作者：
Zheng Jiajia [1 ]
Sun Jiasong [1 ]
机构：
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
来源：
2014 5TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS) | 2014年
关键词：
component; grid computation; parallel computing; massive data; optimization algorithm;
D O I：
暂无
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
The paper uses parallel computation of grid and data grid as theoretical basis. The isomerism of each node and difference of communication rate under grid environment, and massive data query makes query operations of database difficult. For the new structural characteristic, the paper proposes a parallel JOIN algorithm based on massive data, it fully uses parallelism and reduces transmission volume to shorten response time. The paper includes implementation and optimization of JOIN algorithm, fault-tolerant mechanism, RDMM, partition and transmission of massive data.
引用
收藏
页码：933 / 936
页数：4
相关论文
共 50 条
  • [1] A Boundary Filtering Based Spatial Join Query Processing Optimization Algorithm
    Qiao, Baiyou
    Zhu, Junhai
    Shen, Muchuan
    Chen, Yang
    [J]. 2015 12TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD), 2015, : 1764 - 1769
  • [2] Query Optimization for massive RDF data based on Spark
    Li, Shaohui
    Shen, Derong
    Kou, Yue
    Yang, Dan
    [J]. 2018 4TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM 2018), 2018, : 219 - 224
  • [3] Multi-Join Query Optimization in Distributed Database Based on Genetic Algorithm
    Zhu, Jing
    Du, Lin
    [J]. PROGRESS IN INTELLIGENCE COMPUTATION AND APPLICATIONS, 2008, : 188 - 190
  • [4] Graph-based cyclic multi-join query optimization algorithm
    Yu, H
    Wang, XK
    Zhang, JY
    [J]. ADVANCES IN WEB-AGE INFORMATION MANAGEMENT: PROCEEDINGS, 2004, 3129 : 745 - 750
  • [5] Perimeter-Search-Based Semi-Join Query Optimization Algorithm in Data-Sharing Environment
    Wang Xiaoqing
    Fang Youyuan
    Zheng Yanxing
    Zong Jianjian
    Gu Tianyang
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2009, 18 (04) : 593 - 598
  • [6] Massive RDF Data Complicated Query Optimization Based on MapReduce
    Cheng, Jieru
    Wang, Wenjun
    Gao, Rui
    [J]. 2010 INTERNATIONAL CONFERENCE ON COMMUNICATION AND VEHICULAR TECHNOLOGY (ICCVT 2010), VOL I, 2010, : 182 - 185
  • [7] Massive RDF Data Complicated Query Optimization Based on MapReduce
    Cheng, Jieru
    Wang, Wenjun
    Gao, Rui
    [J]. INTERNATIONAL CONFERENCE ON SOLID STATE DEVICES AND MATERIALS SCIENCE, 2012, 25 : 1414 - 1419
  • [8] Query Optimization of Massive Social Network Data Based on HBase
    Bao, Congkai
    Cao, Meiyang
    [J]. 2019 4TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (ICBDA 2019), 2019, : 94 - 97
  • [9] Multi-Join Query Optimization Using the Bees Algorithm
    Alamery, Mohammad
    Faraahi, Ahmad
    Javadi, H. Haj Seyyed
    Nourossana, Sadegh
    Erfani, Hossein
    [J]. DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE, 2010, 79 : 449 - +
  • [10] A join query optimization algorithm in multi-blockchain environment
    Dong, Si-Han
    Xin, Jun-Chang
    Hao, Kun
    Yao, Zhong-Ming
    Chen, Jin-Yi
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (02): : 313 - 321
12345