End-to-end Machine Learning using Kubeflow

被引:4
|
作者
George, Johnu [1 ]
Saha, Amit [2 ]
机构
[1] Nutanix, Bangalore, Karnataka, India
[2] Cisco Syst, Bangalore, Karnataka, India
关键词
MLOps; ML Operations; Kubeflow; Machine Learning;
D O I
10.1145/3493700.3493768
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Usually data scientists are adept in deriving valuable insights from data by applying appropriate machine learning algorithms. However, data scientists are usually not skilled in developing or operating production level software which is the domain of ML Operators. In order to move from initial experiments to production grade systems, the code needs to run at scale on large, realistic data sets, and be able to run on both on-premise equipment as well as on public clouds. Additionally, the entire process needs to be part of some Software Development Lifecycle (SDLC), accounting for some flavour of continuous integration/continuous development (CICD). In this tutorial, attendees will learn about the components of an end-to-end ML system, and will get hands-on experience on model training, hyperparameter tuning, and model deployment. The tutorial will be based on Kubeflow, a widely used open-source (Apache License 2.0) machine learning toolkit for Kubernetes. The related code and examples can be accessed from a public github repository.
引用
下载
收藏
页码:336 / 338
页数:3
相关论文
共 50 条
  • [1] End-to-End Machine Learning with Apache AsterixDB
    Alkowaileet, Wail
    Alsubaiee, Sattam
    Carey, Michael J.
    Li, Chen
    Ramampiaro, Heri
    Sinthong, Phanwadee
    Wang, Xikui
    PROCEEDINGS OF THE SECOND WORKSHOP ON DATA MANAGEMENT FOR END-TO-END MACHINE LEARNING, 2018,
  • [2] Machine Learning for End-to-End Congestion Control
    Zhang, Ticao
    Mao, Shiwen
    IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (06) : 52 - 57
  • [3] Seesaw: End-to-end Dynamic Sensing for IoT using Machine Learning
    Goyal, Vidushi
    Bertacco, Valeria
    Das, Reetuparna
    PROCEEDINGS OF THE 2020 57TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2020,
  • [4] End-to-end Optimization of Machine Learning Prediction Queries
    Park, Kwanghyun
    Saur, Karla
    Banda, Dalitso
    Interlandi, Rathijit Sen Matteo
    Karanasos, Konstantinos
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 587 - 601
  • [5] Provenance Tracking for End-to-End Machine Learning Pipelines
    Grafberger, Stefan
    Groth, Paul
    Schelter, Sebastian
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 1512 - 1512
  • [6] Fully coupled end-to-end drilling optimization model using machine learning
    Hegde, Chiranth
    Pyrcz, Michael
    Millwater, Harry
    Daigle, Hugh
    Gray, Ken
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2020, 186
  • [7] DEEM′22: Data Management for End-to-End Machine Learning
    Boehm, Matthias
    Varma, Paroma
    Xin, Doris
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 2548 - 2549
  • [8] Comparing End-to-End Machine Learning Methods for Spectra Classification
    Sun, Yue
    Brockhauser, Sandor
    Hegedus, Peter
    APPLIED SCIENCES-BASEL, 2021, 11 (23):
  • [9] Exploiting machine learning for end-to-end drug discovery and development
    Ekins, Sean
    Puhl, Ana C.
    Zorn, Kimberley M.
    Lane, Thomas R.
    Russo, Daniel P.
    Klein, Jennifer J.
    Hickey, Anthony J.
    Clark, Alex M.
    NATURE MATERIALS, 2019, 18 (05) : 435 - 441
  • [10] Exploiting machine learning for end-to-end drug discovery and development
    Sean Ekins
    Ana C. Puhl
    Kimberley M. Zorn
    Thomas R. Lane
    Daniel P. Russo
    Jennifer J. Klein
    Anthony J. Hickey
    Alex M. Clark
    Nature Materials, 2019, 18 : 435 - 441