Machine learning operations landscape: platforms and tools

被引:0
|
作者
Berberi, Lisana [1 ]
Kozlov, Valentin [1 ]
Nguyen, Giang [3 ,5 ]
Diaz, Judith Sainz-Pardo [2 ]
Calatrava, Amanda [4 ]
Molto, German [4 ]
Tran, Viet [3 ]
Garcia, Alvaro Lopez [2 ]
机构
[1] Karlsruhe Inst Technol KIT, Sci Comp Ctr SCC, Karlsruhe, Germany
[2] CSIC UC, Inst Fis Cantabria IFCA, Avda Castros S-N, Santander 39005, Spain
[3] Slovak Acad Sci IISAS, Inst Informat, Dubravska Cesta 9, Bratislava 84507, Slovakia
[4] Univ Politecn Valencia, Ctr Mixto CSIC, Inst Instrumentac Imagen Mol I3M, Camino Vera S-N, Valencia 46022, Spain
[5] Slovak Univ Technol Bratislava FIIT STU, Fac Informat & Informat Technol, Ilkovicova 2, Bratislava 84216, Slovakia
关键词
Machine learning operations; MLOps platforms; Performance monitoring; Decision-making;
D O I
10.1007/s10462-025-11164-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As the field of machine learning advances, managing and monitoring intelligent models in production, also known as machine learning operations (MLOps), has become essential. Organizations are increasingly adopting artificial intelligence as a strategic tool, thus increasing the need for reliable, and scalable MLOps platforms. Consequently, every aspect of the machine learning life cycle, from workflow orchestration to performance monitoring, presents both challenges and opportunities that require sophisticated, flexible, and scalable technological solutions. This research addresses this demand by providing a comprehensive assessment framework of MLOps platforms highlighting the key features necessary for a robust MLOps solution. The paper examines 16 MLOps tools widely used, which revolve around capabilities within AI infrastructure management, including but not limited to experiment tracking, model deployment, and model inference. Our three-step evaluation framework starts with a feature analysis of the MLOps platforms, then GitHub stars growth assessment for adoption and prominence, and finally, a weighted scoring method to single out the most influential platforms. From this process, we derive valuable insights into the essential components of effective MLOps systems and provide a decision-making flowchart that simplifies platform selection. This framework provides hands-on guidance for organizations looking to initiate or enhance their MLOps strategies, whether they require an end-end solutions or specialized tools.
引用
收藏
页数:37
相关论文
共 50 条
  • [31] Machine learning tools in production engineering
    Michael Rom
    Matthias Brockmann
    Michael Herty
    Elisa Iacomini
    The International Journal of Advanced Manufacturing Technology, 2022, 121 : 4793 - 4804
  • [32] Modern machine learning tools for crystallography
    Bosetti, Paolo
    Ragni, Matteo
    Leoni, Matteo
    ACTA CRYSTALLOGRAPHICA A-FOUNDATION AND ADVANCES, 2017, 73 : C562 - C562
  • [33] Machine learning tools advance biophysics
    Schlick, Tamar
    Wei, Guo- Wei
    BIOPHYSICAL JOURNAL, 2024, 123 (17) : E1 - E3
  • [34] Machine Learning Tools for Engineering Problems
    Wang, Jing
    2019 25TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC), 2019, : 621 - 621
  • [35] Interpretable Machine Learning Tools: A Survey
    Agarwal, Namita
    Das, Saikat
    2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 1528 - 1534
  • [36] Machine learning tools in production engineering
    Rom, Michael
    Brockmann, Matthias
    Herty, Michael
    Iacomini, Elisa
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 121 (7-8): : 4793 - 4804
  • [37] Development of Machine Learning Tools in ROOT
    Gleyzer, S., V
    Moneta, L.
    Zapata, Omar A.
    17TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH (ACAT2016), 2016, 762
  • [38] COMPARATIVE ANALYSIS OF LEARNING ANALYTICS TOOLS TO IMPROVE LEARNING USED IN DIFFERENT LEARNING PLATFORMS
    Mamcenko, Jelena
    12TH INTERNATIONAL TECHNOLOGY, EDUCATION AND DEVELOPMENT CONFERENCE (INTED), 2018, : 4666 - 4673
  • [39] Tolerance-based selection of machine tools for milling operations
    Toenshoff, Hans Kurt
    Ehrmann, Marc
    ZWF Zeitschrift fuer Wirtschaftlichen Fabrikbetrieb, 1999, 94 (05): : 260 - 263
  • [40] CORRELATION-COEFFICIENTS FOR TRACER OPERATIONS IN MACHINE-TOOLS
    PALLEROSI, CA
    INTERNATIONAL JOURNAL OF MACHINE TOOLS & MANUFACTURE, 1976, 16 (03): : 153 - 164