Query planning for the grid: Adapting to dynamic resource availability

被引:0
|
作者
Zhang, K [1 ]
Andrade, H [1 ]
Raschid, L [1 ]
Sussman, A [1 ]
机构
[1] Univ Maryland, UMIACS, College Pk, MD 20742 USA
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The availability of massive datasets, comprising sensor measurements or the results of scientific simulations, has had a significant impact on the methodology of scientific reasoning. Scientists require storage, bandwidth and computational capacity to query and analyze these datasets, to understand physical phenomena or to test hypotheses. This paper addresses the challenge of identifying and selecting resources to develop an evaluation plan for large scale data analysis queries when data processing capabilities and datasets are dispersed across nodes in one or more computing and storage clusters. We show that generating an optimal plan is hard and we propose heuristic techniques to find a good choice of resources. We also consider heuristics to cope with dynamic resource availability; in this situation we have stale information about reusable cached results (datasets) and the load on various nodes.
引用
收藏
页码:751 / 758
页数:8
相关论文
共 50 条
  • [1] Adapting to changing resource performance in Grid query processing
    Gounaris, A
    Smith, J
    Paton, NW
    Sakellariou, R
    Fernandes, AAA
    Watson, P
    [J]. DATA MANAGEMENT IN GRIDS, 2005, 3836 : 30 - 44
  • [2] Adaptive workflow scheduling in grid computing based on dynamic resource availability
    Garg, Ritu
    Singh, Awadhesh Kumar
    [J]. ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2015, 18 (02): : 256 - 269
  • [3] Research on semantic grid resource query
    Lu, Guoming
    Li, Lemin
    Li, Janping
    Gu, Xiaofeng
    Liu, Hui
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE INFORMATION COMPUTING AND AUTOMATION, VOLS 1-3, 2008, : 64 - +
  • [4] A unified grid query service for grid resource brokers
    Al-Hussaini, L
    Wendelborn, A
    Coddington, P
    [J]. ITCC 2005: International Conference on Information Technology: Coding and Computing, Vol 2, 2005, : 760 - 761
  • [5] Dynamic grid scheduling using job runtime requirements and variable resource availability
    Verboven, Sam
    Hellinckx, Peter
    Broeckhove, Jan
    Arickx, Frans
    [J]. EURO-PAR 2008 PARALLEL PROCESSING, PROCEEDINGS, 2008, 5168 : 223 - 232
  • [6] On the dynamic resource availability in Grids
    Iosup, Alexandru
    Jan, Mathieu
    Sonmez, Ozan
    Epema, Dick H. J.
    [J]. 2007 8TH IEEE/ACM INTERNATIONAL CONFERENCE ON GRID COMPUTING, 2007, : 154 - +
  • [7] Coping with Fluctuations in Resource Availability in Grid Networks
    Batista, Daniel M.
    Curi, Rafael L.
    da Fonseca, Nelson L. S.
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2012,
  • [8] Distributed Resource Discovery in Grid with Efficient Range Query
    Fattahi, Seyed Mehdi
    Charkari, Nasrollah Moghaddam
    [J]. 2009 14TH INTERNATIONAL COMPUTER CONFERENCE, 2009, : 334 - 339
  • [9] Resource availability evaluation in service Grid environment
    Hu Zhoujun
    Hu Zhigang
    Liu Zhenhua
    [J]. 2ND IEEE ASIA-PACIFIC SERVICES COMPUTING CONFERENCE, PROCEEDINGS, 2007, : 232 - 238
  • [10] Resource allocation for query processing in grid systems: a survey
    Cokuslu, Deniz
    Hameurlain, Abdelkader
    Erciyes, Kayhan
    [J]. COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2012, 27 (04): : 239 - 250