Skyport - Container-Based Execution Environment Management for Multi-Cloud Scientific Workflows

被引:64
|
作者
Gerlach, Wolfgang [1 ,2 ]
Tang, Wei [2 ]
Keegan, Kevin [1 ,2 ]
Harrison, Travis [1 ,2 ]
Wilke, Andreas [2 ]
Bischof, Jared [1 ,2 ]
D'Souza, Mark [1 ,2 ]
Devoid, Scott [1 ,2 ]
Murphy-Olson, Daniel [1 ,2 ]
Desai, Narayan [3 ]
Meyer, Folker [1 ,2 ]
机构
[1] Univ Chicago, Chicago, IL 60637 USA
[2] Argonne Natl Lab, Argonne, IL USA
[3] Ericsson, San Jose, CA USA
关键词
D O I
10.1109/DataCloud.2014.6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, Linux container technology has been gaining attention as it promises to transform the way software is developed and deployed. The portability and ease of deployment makes Linux containers an ideal technology to be used in scientific workflow platforms. Skyport utilizes Docker Linux containers to solve software deployment problems and resource utilization inefficiencies inherent to all existing scientific workflow platforms. As an extension to AWE/Shock, our data analysis platform that provides scalable workflow execution environments for scientific data in the cloud, Sky port greatly reduces the complexity associated with providing the environment necessary to execute complex workflows.
引用
收藏
页码:25 / 32
页数:8
相关论文
共 50 条
  • [31] High Availability Management for Applications Services in the Cloud Container-Based Platform
    Alahmad, Yanal
    Agarwal, Anjali
    Daradkeh, Tariq
    2018 IEEE/ACS 15TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2018,
  • [32] Data-driven Workflows in Multi-Cloud Marketplaces
    Diaz-Montes, Javier
    Zou, Mengsong
    Singh, Rahul
    Tao, Shu
    Parashar, Manish
    2014 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2014, : 168 - 175
  • [33] OnTimeURB: Multi-Cloud Resource Brokering for Bioinformatics Workflows
    Pandey, Ashish
    Lyu, Zhen
    Joshi, Trupti
    Calyam, Prasad
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 466 - 473
  • [34] On Scheduling of High-Throughput Scientific Workflows under Budget Constraints in Multi-Cloud Environments
    Li, Ruxia
    Wu, Chase Q.
    Hou, Aiqin
    Wang, Yongqiang
    Gao, Tianyu
    Xu, Mingrui
    2018 IEEE INT CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, UBIQUITOUS COMPUTING & COMMUNICATIONS, BIG DATA & CLOUD COMPUTING, SOCIAL COMPUTING & NETWORKING, SUSTAINABLE COMPUTING & COMMUNICATIONS, 2018, : 1087 - 1094
  • [35] Enabling IoT Stream Management in Multi-Cloud Environment by Orchestration
    Amato, Flora
    Moscato, Francesco
    Xhafa, Fatos
    2018 32ND INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS WORKSHOPS (WAINA), 2018, : 687 - 692
  • [36] Towards a distributed SaaS management system in a multi-cloud environment
    Ouchaou, Linda
    Nacer, Hassina
    Labba, Chahrazed
    Cluster Computing, 2022, 25 (06) : 4051 - 4071
  • [37] Runtime application performance management for multi-cloud CYCLONE environment
    Zivkovic, Miroslav
    Loomis, Charles
    Demchenko, Yuri
    2016 8TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM 2016), 2016, : 614 - 619
  • [38] Towards a distributed SaaS management system in a multi-cloud environment
    Linda Ouchaou
    Hassina Nacer
    Chahrazed Labba
    Cluster Computing, 2022, 25 : 4051 - 4071
  • [39] Quantifying Cloud Elasticity with Container-based Autoscaling
    Tang, Xuxin
    Zhang, Fan
    Li, Xiu
    Khan, Samee U.
    Li, Zhijiang
    2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 853 - 860
  • [40] Quantifying cloud elasticity with container-based autoscaling
    Zhang, Fan
    Tang, Xuxin
    Li, Xiu
    Khan, Samee U.
    Li, Zhijiang
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 98 : 672 - 681