Skyport - Container-Based Execution Environment Management for Multi-Cloud Scientific Workflows

被引：64
|
作者：
Gerlach, Wolfgang [1 ,2 ]
Tang, Wei [2 ]
Keegan, Kevin [1 ,2 ]
Harrison, Travis [1 ,2 ]
Wilke, Andreas [2 ]
Bischof, Jared [1 ,2 ]
D'Souza, Mark [1 ,2 ]
Devoid, Scott [1 ,2 ]
Murphy-Olson, Daniel [1 ,2 ]
Desai, Narayan [3 ]
Meyer, Folker [1 ,2 ]
机构：
[1] Univ Chicago, Chicago, IL 60637 USA
[2] Argonne Natl Lab, Argonne, IL USA
[3] Ericsson, San Jose, CA USA
来源：
2014 5TH INTERNATIONAL WORKSHOP ON DATA-INTENSIVE COMPUTING IN THE CLOUDS (DATACLOUD) | 2014年
关键词：
D O I：
10.1109/DataCloud.2014.6
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Recently, Linux container technology has been gaining attention as it promises to transform the way software is developed and deployed. The portability and ease of deployment makes Linux containers an ideal technology to be used in scientific workflow platforms. Skyport utilizes Docker Linux containers to solve software deployment problems and resource utilization inefficiencies inherent to all existing scientific workflow platforms. As an extension to AWE/Shock, our data analysis platform that provides scalable workflow execution environments for scientific data in the cloud, Sky port greatly reduces the complexity associated with providing the environment necessary to execute complex workflows.
引用
收藏
页码：25 / 32
页数：8
相关论文
共 50 条
  • [21] Improving the Network Performance of a Container-based Cloud Environment for Hadoop Systems
    Rista, Cassiano
    Griebler, Dalvan
    Maron, Carlos A. F.
    Fernandes, Luiz Gustavo
    2017 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2017, : 619 - 626
  • [22] An adaptive parallel execution strategy for cloud-based scientific workflows
    de Oliveira, Daniel
    Ogasawara, Eduardo
    Ocana, Kary
    Baiao, Fernanda
    Mattoso, Marta
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2012, 24 (13): : 1531 - 1550
  • [23] Quick service during DDoS attacks in the container-based cloud environment
    Kumar, Anmol
    Agarwal, Mayank
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 229
  • [24] A Subjective Trust Management System in Multi-Cloud Environment
    Bhadauria, Abhishek Singh
    Mishra, Ashish Kumar
    Saxena, Kshitiz
    Mishra, Shivendu
    2019 9TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2019), 2019, : 38 - 42
  • [25] A Modeling and execution environment for distributed scientific workflows
    Altintas, I
    Bhagwanani, S
    Buttler, D
    Chandra, S
    Cheng, ZG
    Coleman, MA
    Critchlow, T
    Gupta, A
    Han, W
    Liu, L
    Ludäscher, B
    Pu, C
    Moore, R
    Shoshani, A
    Vouk, M
    SSDBM 2002: 15TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2003, : 247 - 250
  • [26] Framework for automated partitioning and execution of scientific workflows in the cloud
    Jaagup Viil
    Satish Narayana Srirama
    The Journal of Supercomputing, 2018, 74 : 2656 - 2683
  • [27] Framework for automated partitioning and execution of scientific workflows in the cloud
    Viil, Jaagup
    Srirama, Satish Narayana
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (06): : 2656 - 2683
  • [28] Execution of scientific workflows on IaaS cloud by PBRR algorithm
    Sundararaman, S. A.
    SubbuLakshmi, T.
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2019, 19 (04) : 455 - 463
  • [29] Management of Container-based Genetic Algorithm Workloads over Cloud Infrastructure
    Alrefai, Thamer
    Indrusiak, Leandro Soares
    17TH ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS 2020 (CF 2020), 2020, : 229 - 232
  • [30] Observability for Quantum Workflows in Heterogeneous Multi-cloud Environments
    Beisel, Martin
    Barzen, Johanna
    Leymann, Frank
    Stiliadou, Lavinia
    Weder, Benjamin
    ADVANCED INFORMATION SYSTEMS ENGINEERING, CAISE 2024, 2024, 14663 : 612 - 627
12345