End-to-end Machine Learning using Kubeflow

被引:4
|
作者
George, Johnu [1 ]
Saha, Amit [2 ]
机构
[1] Nutanix, Bangalore, Karnataka, India
[2] Cisco Syst, Bangalore, Karnataka, India
关键词
MLOps; ML Operations; Kubeflow; Machine Learning;
D O I
10.1145/3493700.3493768
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Usually data scientists are adept in deriving valuable insights from data by applying appropriate machine learning algorithms. However, data scientists are usually not skilled in developing or operating production level software which is the domain of ML Operators. In order to move from initial experiments to production grade systems, the code needs to run at scale on large, realistic data sets, and be able to run on both on-premise equipment as well as on public clouds. Additionally, the entire process needs to be part of some Software Development Lifecycle (SDLC), accounting for some flavour of continuous integration/continuous development (CICD). In this tutorial, attendees will learn about the components of an end-to-end ML system, and will get hands-on experience on model training, hyperparameter tuning, and model deployment. The tutorial will be based on Kubeflow, a widely used open-source (Apache License 2.0) machine learning toolkit for Kubernetes. The related code and examples can be accessed from a public github repository.
引用
下载
收藏
页码:336 / 338
页数:3
相关论文
共 50 条
  • [41] Autonomous Neurosurgical Instrument Segmentation Using End-to-End Learning
    Kalavakonda, Niveditha
    Hannaford, Blake
    Qazi, Zeeshan
    Sekhar, Laligam
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 514 - 516
  • [42] Obstacle avoidance for mobile robots using end-to-end learning
    Kim J.-J.
    Koh D.-Y.
    Park J.
    J. Inst. Control Rob. Syst., 2019, 6 (541-545): : 541 - 545
  • [43] END-TO-END MACHINE LEARNING ON RAW EEG SIGNALS FOR SLEEP STAGE CLASSIFICATION
    Gunnlaugsson, E.
    Ragnarsdottir, H.
    Prainsson, H. M.
    Finnsson, E.
    Jonsson, S. A. E.
    Helgadottir, H.
    Agustsson, J. S.
    Herman, P.
    SLEEP MEDICINE, 2019, 64 : S139 - S139
  • [44] Modal Contrastive Learning Based End-to-End Text Image Machine Translation
    Ma, Cong
    Han, Xu
    Wu, Linghui
    Zhang, Yaping
    Zhao, Yang
    Zhou, Yu
    Zong, Chengqing
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 2153 - 2165
  • [45] An end-to-end machine learning approach with explanation for time series with varying lengths
    Schneider, Manuel
    Greifzu, Norbert
    Wang, Lei
    Walther, Christian
    Wenzel, Andreas
    Li, Pu
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (13): : 7491 - 7508
  • [46] End-to-End Mispronunciation Detection and Diagnosis Using Transfer Learning
    Peng, Linkai
    Gao, Yingming
    Bao, Rian
    Li, Ya
    Zhang, Jinsong
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [47] EasyASR: A Distributed Machine Learning Platform for End-to-end Automatic Speech Recognition
    Wang, Chengyu
    Cheng, Mengli
    Hu, Xu
    Huang, Jun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 16111 - 16113
  • [48] A Machine Learning Approach to End-to-End RTT Estimation and its Application to TCP
    Nunes, Bruno A. A.
    Veenstra, Kerry
    Ballenthin, William
    Lukin, Stephanie
    Obraczka, Katia
    2011 20TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN), 2011,
  • [49] Fast ultrasonic imaging using end-to-end deep learning
    Pilikos, Georgios
    Horchens, Lars
    Batenburg, Kees Joost
    van Leeuwen, Tristan
    Lucka, Felix
    PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2020,
  • [50] Holistic Explainability Requirements for End-to-End Machine Learning in IoT Cloud Systems
    My-Linh Nguyen
    Thao Phung
    Duong-Hai Ly
    Hong-Linh Truong
    29TH IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE WORKSHOPS (REW 2021), 2021, : 188 - 194