Skyport - Container-Based Execution Environment Management for Multi-Cloud Scientific Workflows

被引：64
|
作者：
Gerlach, Wolfgang [1 ,2 ]
Tang, Wei [2 ]
Keegan, Kevin [1 ,2 ]
Harrison, Travis [1 ,2 ]
Wilke, Andreas [2 ]
Bischof, Jared [1 ,2 ]
D'Souza, Mark [1 ,2 ]
Devoid, Scott [1 ,2 ]
Murphy-Olson, Daniel [1 ,2 ]
Desai, Narayan [3 ]
Meyer, Folker [1 ,2 ]
机构：
[1] Univ Chicago, Chicago, IL 60637 USA
[2] Argonne Natl Lab, Argonne, IL USA
[3] Ericsson, San Jose, CA USA
来源：
2014 5TH INTERNATIONAL WORKSHOP ON DATA-INTENSIVE COMPUTING IN THE CLOUDS (DATACLOUD) | 2014年
关键词：
D O I：
10.1109/DataCloud.2014.6
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Recently, Linux container technology has been gaining attention as it promises to transform the way software is developed and deployed. The portability and ease of deployment makes Linux containers an ideal technology to be used in scientific workflow platforms. Skyport utilizes Docker Linux containers to solve software deployment problems and resource utilization inefficiencies inherent to all existing scientific workflow platforms. As an extension to AWE/Shock, our data analysis platform that provides scalable workflow execution environments for scientific data in the cloud, Sky port greatly reduces the complexity associated with providing the environment necessary to execute complex workflows.
引用
下载
收藏
页码：25 / 32
页数：8
相关论文
共 50 条
  • [1] Execution of Scientific Workflows on Federated Multi-cloud Infrastructures
    Lezzi, Daniele
    Lordan, Francesc
    Rafanell, Roger
    Badia, Rosa M.
    EURO-PAR 2013: PARALLEL PROCESSING WORKSHOPS, 2014, 8374 : 136 - 145
  • [2] Flexible Container-Based Computing Platform on Cloud for Scientific Workflows
    Liu, Kai
    Aida, Kento
    Yokoyama, Shigetoshi
    Masatani, Yoshinobu
    2016 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING RESEARCH AND INNOVATION - ICCCRI 2016, 2016, : 56 - 63
  • [3] Optimized Container-Based Process Execution in the Cloud
    Waibel, Philipp
    Yeshchenko, Anton
    Schulte, Stefan
    Mendling, Jan
    ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS (OTM 2018), PT II, 2018, 11230 : 3 - 21
  • [4] GMTA: A Geo-Aware Multi-Agent Task Allocation Approach for Scientific Workflows in Container-Based Cloud
    Niu, Meng
    Cheng, Bo
    Feng, Yimeng
    Chen, Junliang
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (03): : 1568 - 1581
  • [5] Scheduling Data-Driven Workflows in Multi-Cloud Environment
    Sooezi, Nafise
    Abrishami, Saeid
    Lotfian, Majid
    2015 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), 2015, : 163 - 167
  • [6] Dynamic Execution of Scientific Workflows in Cloud
    Kail, E.
    Kovacs, J.
    Kozlovszky, M.
    Kacsuk, P.
    2016 39TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2016, : 332 - 336
  • [7] Optimal Mapping of Workflows Using Serverless Architecture in a Multi-Cloud Environment
    Ramesh, Manju
    Phalak, Chetan
    Chahal, Dheeraj
    Singhal, Rekha
    IEEE 21ST INTERNATIONAL CONFERENCE ON SOFTWARE ARCHITECTURE COMPANION, ICSA-C 2024, 2024, : 252 - 259
  • [8] Container-based Service State Management in Cloud Computing
    Nath, Shubha Brata
    Addya, Sourav Kanti
    Chakraborty, Sandip
    Ghosh, Soumya K.
    2021 IFIP/IEEE INTERNATIONAL SYMPOSIUM ON INTEGRATED NETWORK MANAGEMENT (IM 2021), 2021, : 487 - 493
  • [9] A container-based cloud-native architecture for the reproducible execution of multi-population optimization algorithms
    Garcia Valdez, Mario
    Merelo Guervos, Juan J.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 116 : 234 - 252
  • [10] Cloud infrastructure provenance collection and management to reproduce scientific workflows execution
    Hasham, Khawar
    Munir, Kamran
    McClatchey, Richard
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 799 - 820
12345