Skyport - Container-Based Execution Environment Management for Multi-Cloud Scientific Workflows

被引:64
|
作者
Gerlach, Wolfgang [1 ,2 ]
Tang, Wei [2 ]
Keegan, Kevin [1 ,2 ]
Harrison, Travis [1 ,2 ]
Wilke, Andreas [2 ]
Bischof, Jared [1 ,2 ]
D'Souza, Mark [1 ,2 ]
Devoid, Scott [1 ,2 ]
Murphy-Olson, Daniel [1 ,2 ]
Desai, Narayan [3 ]
Meyer, Folker [1 ,2 ]
机构
[1] Univ Chicago, Chicago, IL 60637 USA
[2] Argonne Natl Lab, Argonne, IL USA
[3] Ericsson, San Jose, CA USA
关键词
D O I
10.1109/DataCloud.2014.6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, Linux container technology has been gaining attention as it promises to transform the way software is developed and deployed. The portability and ease of deployment makes Linux containers an ideal technology to be used in scientific workflow platforms. Skyport utilizes Docker Linux containers to solve software deployment problems and resource utilization inefficiencies inherent to all existing scientific workflow platforms. As an extension to AWE/Shock, our data analysis platform that provides scalable workflow execution environments for scientific data in the cloud, Sky port greatly reduces the complexity associated with providing the environment necessary to execute complex workflows.
引用
下载
收藏
页码:25 / 32
页数:8
相关论文
共 50 条
  • [41] Container-based Microservice Architecture for Cloud Applications
    Singh, Vindeep
    Peddoju, Sateesh K.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2017, : 847 - 852
  • [42] Container-based Module Isolation for Cloud Services
    Kehrer, Stefan
    Riebandt, Florian
    Blochinger, Wolfgang
    2019 13TH IEEE INTERNATIONAL CONFERENCE ON SERVICE-ORIENTED SYSTEM ENGINEERING (SOSE) / 10TH INTERNATIONAL WORKSHOP ON JOINT CLOUD COMPUTING (JCC) / IEEE INTERNATIONAL WORKSHOP ON CLOUD COMPUTING IN ROBOTIC SYSTEMS (CCRS), 2019, : 177 - 186
  • [43] Container-Based Cloud Virtual Machine Benchmarking
    Varghese, Blesson
    Subba, Lawan Thamsuhang
    Thai, Long
    Barker, Adam
    PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E), 2016, : 192 - 201
  • [44] Towards a distributed SaaS management system in a multi-cloud environment
    Ochaou, Linda
    Nacer, Hassina
    Labba, Chahrazed
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (06): : 4051 - 4071
  • [45] ScyFlow:: an environment for the visual specification and execution of scientific workflows
    McCann, Karen M.
    Yarrow, Maurice
    DeVivo, Adrian
    Mehrotra, Piyush
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2006, 18 (10): : 1155 - 1167
  • [46] Facilitating the Reproducibility of Scientific Workflows with Execution Environment Specifications
    Meng, Haiyan
    Thain, Douglas
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 705 - 714
  • [47] Adaptive golden eagle optimization based multi-objective scientific workflow scheduling on multi-cloud environment
    S. Immaculate Shyla
    T. Beula Bell
    C. Jaspin Jeba Sheela
    Multimedia Tools and Applications, 2024, 83 : 47175 - 47198
  • [48] A performance comparison of container-based technologies for the Cloud
    Kozhirbayev, Zhanibek
    Sinnott, Richard O.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 68 : 175 - 182
  • [49] Adaptive golden eagle optimization based multi-objective scientific workflow scheduling on multi-cloud environment
    Shyla, S. Immaculate
    Bell, T. Beula
    Sheela, C. Jaspin Jeba
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 47175 - 47198
  • [50] Dynamic Deployment of Scientific Workflows in the Cloud using Container Virtualization
    Qasha, Rawaa
    Cala, Jacek
    Watson, Paul
    2016 8TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM 2016), 2016, : 269 - 276