Building A Platform for Machine Learning Operations from Open Source Frameworks

被引:6
|
作者
Liu, Yan [1 ]
Ling, Zhijing [1 ]
Huo, Boyu [1 ]
Wang, Boqian [1 ]
Chen, Tianen [1 ]
Mouine, Esma [1 ]
机构
[1] Concordia Univ, Gina Cody Sch Engn & Comp Sci, Montreal, PQ H3G 1M8, Canada
来源
IFAC PAPERSONLINE | 2020年 / 53卷 / 05期
关键词
Machine Learning; DevOps; Software Architecture; Open Source;
D O I
10.1016/j.ifacol.2021.04.161
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Machine Learning Operations (MLOps) aim to establish a set of practices that put tools, pipelines, and processes to build fast time-to-value machine learning development projects. The lifecycle of machine learning project development encompasses a set of roles, stacks of software frameworks and multiple types of computing resources. Such complexity makes MLOps support usually bundled with commercial cloud platforms that is referred as vendor lock. In this paper, we provide an alternative solution that devises a MLOps platform with open source frameworks on any virtual resources. Our MLOps approach is driven by the development roles of machine learning models. The tool chain of our MLOps connects to the typical CI/CD workflow of machine learning applications. We demonstrate a working example of training and deploying a model for the application of detecting software repository code vulnerability. Copyright (C) 2020 The Authors.
引用
收藏
页码:704 / 709
页数:6
相关论文
共 50 条
  • [1] pyStudio: An Open-Source Machine Learning Platform
    Gomicia-Murcia, Enrique
    Bordel Sanchez, Borja
    Souissi, Riad
    AL-Qurishi, Muhammad
    PROCEEDINGS OF THE 2023 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2023, 2023, : 436 - 440
  • [2] Open Source Machine Learning Frameworks for Industrial Internet of Things
    Khan, Asharul Islam
    Al-Badi, Ali
    11TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 3RD INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2020, 170 : 571 - 577
  • [3] Open Source Platforms and Frameworks for Artificial Intelligence and Machine Learning
    Bhattacharya, Sambit
    Czejdo, Bogdan
    Agrawal, Rajeev
    Erdemir, Erdem
    Gokaraju, Balakrishna
    IEEE SOUTHEASTCON 2018, 2018,
  • [4] Building Machine Learning Models like Open Source Software
    Raffel, Colin
    COMMUNICATIONS OF THE ACM, 2023, 66 (02) : 38 - 40
  • [5] A Bayesian machine learning model for estimating building occupancy from open source data
    Robert Stewart
    Marie Urban
    Samantha Duchscherer
    Jason Kaufman
    April Morton
    Gautam Thakur
    Jesse Piburn
    Jessica Moehl
    Natural Hazards, 2016, 81 : 1929 - 1956
  • [6] A Bayesian machine learning model for estimating building occupancy from open source data
    Stewart, Robert
    Urban, Marie
    Duchscherer, Samantha
    Kaufman, Jason
    Morton, April
    Thakur, Gautam
    Piburn, Jesse
    Moehl, Jessica
    NATURAL HAZARDS, 2016, 81 (03) : 1929 - 1956
  • [7] Building Forecasting Solutions Using Open-Source and Azure Machine Learning
    Hu, Chenhui
    Paunic, Vanja
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3497 - 3498
  • [8] Qsun: an open-source platform towards practical quantum machine learning applications
    Quoc Chuong Nguyen
    Le Bin Ho
    Lan Nguyen Tran
    Nguyen, Hung Q.
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (01):
  • [9] An Open Source C Code Generator and a Tiny Machine Learning Toolchain for the SENSIPLUS Platform
    Bria, A.
    Ferrigno, L.
    Marrocco, C.
    Molinara, M.
    Vitelli, M.
    Ria, A.
    Cicalini, M.
    Manfredini, G.
    Bruschi, P.
    2022 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING (SMARTCOMP 2022), 2022, : 263 - 268
  • [10] Open source machine vision platform for manufacturing and robotics
    Raileanu, Silviu
    Borangiu, Theodor
    Anton, Florin
    Anton, Silvia
    IFAC PAPERSONLINE, 2021, 54 (01): : 522 - 527