Building A Platform for Machine Learning Operations from Open Source Frameworks

被引:6
|
作者
Liu, Yan [1 ]
Ling, Zhijing [1 ]
Huo, Boyu [1 ]
Wang, Boqian [1 ]
Chen, Tianen [1 ]
Mouine, Esma [1 ]
机构
[1] Concordia Univ, Gina Cody Sch Engn & Comp Sci, Montreal, PQ H3G 1M8, Canada
来源
IFAC PAPERSONLINE | 2020年 / 53卷 / 05期
关键词
Machine Learning; DevOps; Software Architecture; Open Source;
D O I
10.1016/j.ifacol.2021.04.161
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Machine Learning Operations (MLOps) aim to establish a set of practices that put tools, pipelines, and processes to build fast time-to-value machine learning development projects. The lifecycle of machine learning project development encompasses a set of roles, stacks of software frameworks and multiple types of computing resources. Such complexity makes MLOps support usually bundled with commercial cloud platforms that is referred as vendor lock. In this paper, we provide an alternative solution that devises a MLOps platform with open source frameworks on any virtual resources. Our MLOps approach is driven by the development roles of machine learning models. The tool chain of our MLOps connects to the typical CI/CD workflow of machine learning applications. We demonstrate a working example of training and deploying a model for the application of detecting software repository code vulnerability. Copyright (C) 2020 The Authors.
引用
收藏
页码:704 / 709
页数:6
相关论文
共 50 条
  • [41] Building a Medical Learning Methodology Based on Open Source Technologies
    de Castro, Antonio Vieira
    de Carvalho, Carlos Vaz
    Carrapatoso, Eurico
    2011 FRONTIERS IN EDUCATION CONFERENCE (FIE), 2011,
  • [42] The Machine Learning Life Cycle in Chemical Operations - Status and Open Challenges
    Gaertler, Marco
    Khaydarov, Valentin
    Klopper, Benjamin
    Urbas, Leon
    CHEMIE INGENIEUR TECHNIK, 2021, 93 (12) : 2063 - 2080
  • [43] Building Automatic Clouds with an Open-source and Deployable Platform-as-a-service
    Petcu, Dana
    CLOUD COMPUTING AND BIG DATA, 2013, 23 : 3 - 19
  • [44] A STRATEGY FOR BUILDING A SMART SPORTS PLATFORM BASED ON MACHINE LEARNING MODELS
    Gong, Mingchan
    3C TIC, 2023, 12 (01): : 248 - 265
  • [45] Fundamental requirements of a machine learning operations platform for industrial metal additive manufacturing
    Safdar, Mutahar
    Paul, Padma Polash
    Lamouche, Guy
    Wood, Gentry
    Zimmermann, Max
    Hannesen, Florian
    Bescond, Christophe
    Wanjara, Priti
    Zhao, Yaoyao Fiona
    COMPUTERS IN INDUSTRY, 2024, 154
  • [46] Open-source machine learning: R meets Weka
    Kurt Hornik
    Christian Buchta
    Achim Zeileis
    Computational Statistics, 2009, 24 : 225 - 232
  • [47] How Open Source Machine Learning Software Shapes AI
    Langenkamp, Max
    Yue, Daniel N.
    PROCEEDINGS OF THE 2022 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY, AIES 2022, 2022, : 385 - 395
  • [48] Exploring Open Source for Machine Learning Problem on Diabetic Retinopathy
    Kumari, Archana
    Choudhury, Tanupriya
    Rajagopal, P. Chitra
    EMERGING TRENDS IN EXPERT APPLICATIONS AND SECURITY, 2019, 841 : 565 - 574
  • [49] Open-source machine learning: R meets Weka
    Hornik, Kurt
    Buchta, Christian
    Zeileis, Achim
    COMPUTATIONAL STATISTICS, 2009, 24 (02) : 225 - 232
  • [50] Machine Learning Approach for Reliability Assessment of Open Source Software
    Behera, Ranjan Kumar
    Rath, Santanu Kumar
    Misra, Sanjay
    Leon, Marcelo
    Adewumi, Adewole
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS, ICCSA 2019, PT IV, 2019, 11622 : 472 - 482