Building A Platform for Machine Learning Operations from Open Source Frameworks

被引:6
|
作者
Liu, Yan [1 ]
Ling, Zhijing [1 ]
Huo, Boyu [1 ]
Wang, Boqian [1 ]
Chen, Tianen [1 ]
Mouine, Esma [1 ]
机构
[1] Concordia Univ, Gina Cody Sch Engn & Comp Sci, Montreal, PQ H3G 1M8, Canada
来源
IFAC PAPERSONLINE | 2020年 / 53卷 / 05期
关键词
Machine Learning; DevOps; Software Architecture; Open Source;
D O I
10.1016/j.ifacol.2021.04.161
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Machine Learning Operations (MLOps) aim to establish a set of practices that put tools, pipelines, and processes to build fast time-to-value machine learning development projects. The lifecycle of machine learning project development encompasses a set of roles, stacks of software frameworks and multiple types of computing resources. Such complexity makes MLOps support usually bundled with commercial cloud platforms that is referred as vendor lock. In this paper, we provide an alternative solution that devises a MLOps platform with open source frameworks on any virtual resources. Our MLOps approach is driven by the development roles of machine learning models. The tool chain of our MLOps connects to the typical CI/CD workflow of machine learning applications. We demonstrate a working example of training and deploying a model for the application of detecting software repository code vulnerability. Copyright (C) 2020 The Authors.
引用
收藏
页码:704 / 709
页数:6
相关论文
共 50 条
  • [21] ARLearn Open Source Mobile Application Platform for Learning
    Boerner, Dirk
    Ternier, Stefaan
    Klemke, Roland
    Schmitz, Birgit
    Kalz, Marco
    Tabuenca, Bernardo
    Specht, Marcus
    SCALING UP LEARNING FOR SUSTAINED IMPACT, 2013, 8095 : 536 - 539
  • [22] The Open-Closed Principle of Modern Machine Learning Frameworks
    Ben Braiek, Houssem
    Khomh, Foutse
    Adams, Bram
    2018 IEEE/ACM 15TH INTERNATIONAL CONFERENCE ON MINING SOFTWARE REPOSITORIES (MSR), 2018, : 353 - 363
  • [23] Saga: An Open Source Platform for Training Machine Learning Models and Community-driven Sharing of Techniques
    Borgli, Rune Johan
    Stensland, Hakon Kvale
    Halvorsen, Pal
    Riegler, Michael Alexander
    2019 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2019,
  • [24] A Multi-Protocol IoT Platform Based on Open-Source Frameworks
    Akasiadis, Charilaos
    Pitsilis, Vassilis
    Spyropoulos, Constantine D.
    SENSORS, 2019, 19 (19)
  • [25] RDKit: Open-source cheminformatics from machine learning to chemical registration
    Landrum, Gregory
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2019, 258
  • [26] An Agent-based Open Source Platform for Building Energy Management
    Khamphanchai, W.
    Pipattanasomporn, M.
    Kuzlu, M.
    Rahman, S.
    2015 IEEE INNOVATIVE SMART GRID TECHNOLOGIES - ASIA (ISGT ASIA), 2015,
  • [27] Open source platform application for smart building and smart grid controls
    Blechmann, Sebastian
    Sowa, Igor
    Schraven, Markus Hans
    Streblow, Rita
    Mueller, Dirk
    Monti, Antonello
    AUTOMATION IN CONSTRUCTION, 2023, 145
  • [28] Building BESSER: An Open-Source Low-Code Platform
    Alfonso, Ivan
    Conrardy, Aaron
    Sulejmani, Armen
    Nirumand, Atefeh
    Ul Haq, Fitash
    Gomez-Vazquez, Marcos
    Sottet, Jean-Sebastien
    Cabot, Jordi
    ENTERPRISE, BUSINESS-PROCESS AND INFORMATION SYSTEMS MODELING, BPMDS 2024, EMMSAD 2024, 2024, 511 : 203 - 212
  • [29] Open-Source Machine Learning in Computational Chemistry
    Hagg, Alexander
    Kirschner, Karl N.
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2023, 63 (15) : 4505 - 4532
  • [30] A Machine Learning Operations Platform for Streamlined Model Serving in Industry 5.0
    Colombi, Lorenzo
    Gilli, Alessandro
    Dahdal, Simon
    Boleac, Ion
    Tortonesi, Mauro
    Stefanelli, Cesare
    Vignoli, Massimiliano
    PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024, 2024,