Task scheduling of massive spatial data processing across distributed data centers: what's new?

被引：6
|
作者：
Song, Weijing [1 ]
Yue, Shasha [1 ]
Wang, Lizhe [1 ]
Zhang, Wanfeng [1 ]
Liu, Dingsheng [1 ]
机构：
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100864, Peoples R China
来源：
2011 IEEE 17TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS) | 2011年
关键词：
Massive data processing; spatial data infrastructure; task scheduling; INFRASTRUCTURE; SCIENCE; SYSTEM;
D O I：
10.1109/ICPADS.2011.134
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Spatial data processing in general involves large-scale distributed computing resources across multiple data centers and distributed massive data sets. Task scheduling of spatial data processing across distributed data centers brings new research issues and calls for novel scheduling mechanisms and frameworks. This paper analyzes the features of spatial data processing, identifies the research issues of task scheduling in massive spatial data processing, and proposes task model & scheduling mechanisms for task scheduling in spatial data processing.
引用
收藏
页码：976 / 981
页数：6
相关论文
共 50 条
  • [1] Design and implementation of task scheduling strategies for massive remote sensing data processing across multiple data centers
    Zhang, Wanfeng
    Wang, Lizhe
    Ma, Yan
    Liu, Dingsheng
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 2014, 44 (07): : 873 - 886
  • [2] Spatial Task Scheduling for Cost Minimization in Distributed Green Cloud Data Centers
    Yuan, Haitao
    Bi, Jing
    Zhou, MengChu
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2019, 16 (02) : 729 - 740
  • [3] Biobjective Task Scheduling for Distributed Green Data Centers
    Yuan, Haitao
    Bi, Jing
    Zhou, MengChu
    Liu, Qing
    Ammari, Ahmed Chiheb
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) : 731 - 742
  • [4] Time- and Cost- Efficient Task Scheduling across Geo-Distributed Data Centers
    Hu, Zhiming
    Li, Baochun
    Luo, Jun
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (03) : 705 - 718
  • [5] JHTD: An Efficient Joint Scheduling Framework Based on Hypergraph for Task Placement and Data Transfer Across Geographically Distributed Data Centers
    Jing, Chao
    Dan, Penggao
    [J]. IEEE ACCESS, 2022, 10 : 116302 - 116316
  • [6] Energy Consumption and Performance Optimized Task Scheduling in Distributed Data Centers
    Yuan, Haitao
    Bi, Jing
    Zhang, Jia
    Zhou, MengChu
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (09): : 5506 - 5517
  • [7] MapReduce Task Scheduling in Heterogeneous Geo-Distributed Data Centers
    Li, Xiaoping
    Chen, Fuchao
    Ruiz, Ruben
    Zhu, Jie
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (06) : 3317 - 3329
  • [8] A Hypergraph Based Task Scheduling Strategy for Massive Parallel Spatial Data Processing on Master-Slave Platforms
    Cheng, Bo
    Guan, Xuefeng
    Wu, Huayi
    [J]. 2015 23RD INTERNATIONAL CONFERENCE ON GEOINFORMATICS, 2015,
  • [9] Workload-Aware Scheduling Across Geo-distributed Data Centers
    Jin, Yibo
    Gao, Yuan
    Qian, Zhuzhong
    Zhai, Mingyu
    Peng, Hui
    Lu, Sanglu
    [J]. 2016 IEEE TRUSTCOM/BIGDATASE/ISPA, 2016, : 1455 - 1462
  • [10] Task Scheduling in Data Stream Processing
    Falt, Zbynek
    Yaghob, Jakub
    [J]. DATESO 2011: DATABASES, TEXTS, SPECIFICATIONS, OBJECTS, 2011, 706 : 85 - 96
12345