Optimization Algorithm of Massive Data Query Based on JOIN

被引:0
|
作者
Zheng Jiajia [1 ]
Sun Jiasong [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
关键词
component; grid computation; parallel computing; massive data; optimization algorithm;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The paper uses parallel computation of grid and data grid as theoretical basis. The isomerism of each node and difference of communication rate under grid environment, and massive data query makes query operations of database difficult. For the new structural characteristic, the paper proposes a parallel JOIN algorithm based on massive data, it fully uses parallelism and reduces transmission volume to shorten response time. The paper includes implementation and optimization of JOIN algorithm, fault-tolerant mechanism, RDMM, partition and transmission of massive data.
引用
收藏
页码:933 / 936
页数:4
相关论文
共 50 条
  • [41] SJCBMQ: A novel spatial join-based algorithm for continuous border monitoring query processing in data streams
    Zhang, Yunyi
    Huang, Chongzheng
    Zhang, Deyun
    [J]. 2007 2ND INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND APPLICATIONS, VOLS 1 AND 2, 2007, : 291 - +
  • [42] Research on classification query optimization algorithm in data stream
    Zhou Hong
    Wang Bin
    Fu Chunyan
    Zhi Yuan
    Xue Jiamei
    [J]. PROCEEDINGS OF THE 2015 2ND INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER ENGINEERING AND ELECTRONICS (ICECEE 2015), 2015, 24 : 1219 - 1223
  • [43] PathStack: A holistic path join algorithm for path query with not-predicates on XML data
    Jiao, E
    Ling, TW
    Chan, CY
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PROCEEDINGS, 2005, 3453 : 113 - 124
  • [44] Improved Multi Join Query Optimization for RDBMS Based on Swarm Intelligence Approaches
    Al-Saedi, Ahmed Khalaf Zager
    Ghazali, Rozaida
    Deris, Mustafa Mat
    [J]. ADVANCED SCIENCE LETTERS, 2016, 22 (10) : 2847 - 2851
  • [45] Coral: federated query join order optimization based on deep reinforcement learning
    Gu, Rong
    Zhang, Yi
    Yin, Liangliang
    Song, Lingyi
    Huang, Wenjie
    Yuan, Chunfeng
    Wang, Zhaokang
    Zhu, Guanghui
    Huang, Yihua
    [J]. WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05): : 3093 - 3118
  • [46] Coral: federated query join order optimization based on deep reinforcement learning
    Rong Gu
    Yi Zhang
    Liangliang Yin
    Lingyi Song
    Wenjie Huang
    Chunfeng Yuan
    Zhaokang Wang
    Guanghui Zhu
    Yihua Huang
    [J]. World Wide Web, 2023, 26 : 3093 - 3118
  • [47] Join Query Processing in Data Quality Management
    Yue, Mingliang
    Gao, Hong
    Shi, Shengfei
    Wang, Hongzhi
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2016, 2016, 9645 : 329 - 342
  • [48] Parallel multi-join query optimization algorithm for distributed sensor network in the internet of things
    Zheng, Yan
    [J]. SMART SENSOR PHENOMENA, TECHNOLOGY, NETWORKS, AND SYSTEMS INTEGRATION 2015, 2015, 9436
  • [49] Approximate join aggregate on massive data
    Han, Xi-Xian
    Yang, Dong-Hua
    Li, Jian-Zhong
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2010, 33 (10): : 1919 - 1933
  • [50] An efficient progressive spatial Join query processing algorithm
    Tang, Gui-Fen
    Yang, Wei-Feng
    Huang, Shuang-Lin
    Li, Wei
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2009, 37 (02): : 318 - 324