Machine learning operations landscape: platforms and tools

被引:0
|
作者
Berberi, Lisana [1 ]
Kozlov, Valentin [1 ]
Nguyen, Giang [3 ,5 ]
Diaz, Judith Sainz-Pardo [2 ]
Calatrava, Amanda [4 ]
Molto, German [4 ]
Tran, Viet [3 ]
Garcia, Alvaro Lopez [2 ]
机构
[1] Karlsruhe Inst Technol KIT, Sci Comp Ctr SCC, Karlsruhe, Germany
[2] CSIC UC, Inst Fis Cantabria IFCA, Avda Castros S-N, Santander 39005, Spain
[3] Slovak Acad Sci IISAS, Inst Informat, Dubravska Cesta 9, Bratislava 84507, Slovakia
[4] Univ Politecn Valencia, Ctr Mixto CSIC, Inst Instrumentac Imagen Mol I3M, Camino Vera S-N, Valencia 46022, Spain
[5] Slovak Univ Technol Bratislava FIIT STU, Fac Informat & Informat Technol, Ilkovicova 2, Bratislava 84216, Slovakia
关键词
Machine learning operations; MLOps platforms; Performance monitoring; Decision-making;
D O I
10.1007/s10462-025-11164-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As the field of machine learning advances, managing and monitoring intelligent models in production, also known as machine learning operations (MLOps), has become essential. Organizations are increasingly adopting artificial intelligence as a strategic tool, thus increasing the need for reliable, and scalable MLOps platforms. Consequently, every aspect of the machine learning life cycle, from workflow orchestration to performance monitoring, presents both challenges and opportunities that require sophisticated, flexible, and scalable technological solutions. This research addresses this demand by providing a comprehensive assessment framework of MLOps platforms highlighting the key features necessary for a robust MLOps solution. The paper examines 16 MLOps tools widely used, which revolve around capabilities within AI infrastructure management, including but not limited to experiment tracking, model deployment, and model inference. Our three-step evaluation framework starts with a feature analysis of the MLOps platforms, then GitHub stars growth assessment for adoption and prominence, and finally, a weighted scoring method to single out the most influential platforms. From this process, we derive valuable insights into the essential components of effective MLOps systems and provide a decision-making flowchart that simplifies platform selection. This framework provides hands-on guidance for organizations looking to initiate or enhance their MLOps strategies, whether they require an end-end solutions or specialized tools.
引用
收藏
页数:37
相关论文
共 50 条
  • [41] Using the Activity Theory to Identify the Challenges of Designing Elearning Tools based on Machine Learning for Security Operations Centers
    Cazacu, Mihail
    Bodea, Constanta
    Dascalu, Maria-Iuliana
    Cucu, Cristian
    NEW TECHNOLOGIES AND REDESIGNING LEARNING SPACES, VOL I, 2019, : 452 - 461
  • [42] Using Machine-Learning techniques and Virtual Reality to design cutting tools for energy optimization in milling operations
    Checa, David
    Urbikain, Gorka
    Beranoagirre, Aitor
    Bustillo, Andres
    Lopez de Lacalle, Luis Norberto
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2022, 35 (09) : 951 - 971
  • [43] Internet of Things Learning Methodologies, Teaching Tools and Teaching Platforms
    Ronoh, Kennedy
    Muli, Elizabeth
    Ngwawe, Edwin
    Njuki, Sam
    INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 850 - 855
  • [44] Improving healthcare operations management with machine learning
    Pianykh, Oleg S.
    Guitron, Steven
    Parke, Darren
    Zhang, Chengzhao
    Pandharipande, Pari
    Brink, James
    Rosenthal, Daniel
    NATURE MACHINE INTELLIGENCE, 2020, 2 (05) : 266 - +
  • [45] Improving healthcare operations management with machine learning
    Oleg S. Pianykh
    Steven Guitron
    Darren Parke
    Chengzhao Zhang
    Pari Pandharipande
    James Brink
    Daniel Rosenthal
    Nature Machine Intelligence, 2020, 2 : 266 - 273
  • [46] Understanding the Impact of AI and Machine Learning on Operations
    Caines, Jaxon
    Hart's E and P, 2024, 99 (02): : 50 - 52
  • [47] Machine learning for drone operations: challenge accepted
    Baskaya, Elgiz
    Bronz, Murat
    2020 AIAA/IEEE 39TH DIGITAL AVIONICS SYSTEMS CONFERENCE (DASC) PROCEEDINGS, 2020,
  • [48] Machine Learning and Optimization for Resource-Constrained Platforms
    Barnes, Patrick
    Murawski, Robert
    2019 IEEE COGNITIVE COMMUNICATIONS FOR AEROSPACE APPLICATIONS WORKSHOP (CCAAW), 2019,
  • [49] A Survey on Machine Learning Accelerators and Evolutionary Hardware Platforms
    Bavikadi, Sathwika
    Dhavlle, Abhijitt
    Ganguly, Amlan
    Haridass, Anand
    Hendy, Hagar
    Merkel, Cory
    Reddi, Vijay Janapa
    Sutradhar, Purab Ranjan
    Joseph, Arun
    Pudukotai Dinakarrao, Sai Manoj
    IEEE DESIGN & TEST, 2022, 39 (03) : 91 - 116
  • [50] Evaluating automated machine learning platforms for use in healthcare
    Scott, Ian A.
    De Guzman, Keshia R.
    Falconer, Nazanin
    Canaris, Stephen
    Bonilla, Oscar
    McPhail, Steven M.
    Marxen, Sven
    Van Garderen, Aaron
    Abdel-Hafez, Ahmad
    Barras, Michael
    JAMIA OPEN, 2024, 7 (02)