Machine learning operations landscape: platforms and tools

被引:0
|
作者
Berberi, Lisana [1 ]
Kozlov, Valentin [1 ]
Nguyen, Giang [3 ,5 ]
Diaz, Judith Sainz-Pardo [2 ]
Calatrava, Amanda [4 ]
Molto, German [4 ]
Tran, Viet [3 ]
Garcia, Alvaro Lopez [2 ]
机构
[1] Karlsruhe Inst Technol KIT, Sci Comp Ctr SCC, Karlsruhe, Germany
[2] CSIC UC, Inst Fis Cantabria IFCA, Avda Castros S-N, Santander 39005, Spain
[3] Slovak Acad Sci IISAS, Inst Informat, Dubravska Cesta 9, Bratislava 84507, Slovakia
[4] Univ Politecn Valencia, Ctr Mixto CSIC, Inst Instrumentac Imagen Mol I3M, Camino Vera S-N, Valencia 46022, Spain
[5] Slovak Univ Technol Bratislava FIIT STU, Fac Informat & Informat Technol, Ilkovicova 2, Bratislava 84216, Slovakia
关键词
Machine learning operations; MLOps platforms; Performance monitoring; Decision-making;
D O I
10.1007/s10462-025-11164-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As the field of machine learning advances, managing and monitoring intelligent models in production, also known as machine learning operations (MLOps), has become essential. Organizations are increasingly adopting artificial intelligence as a strategic tool, thus increasing the need for reliable, and scalable MLOps platforms. Consequently, every aspect of the machine learning life cycle, from workflow orchestration to performance monitoring, presents both challenges and opportunities that require sophisticated, flexible, and scalable technological solutions. This research addresses this demand by providing a comprehensive assessment framework of MLOps platforms highlighting the key features necessary for a robust MLOps solution. The paper examines 16 MLOps tools widely used, which revolve around capabilities within AI infrastructure management, including but not limited to experiment tracking, model deployment, and model inference. Our three-step evaluation framework starts with a feature analysis of the MLOps platforms, then GitHub stars growth assessment for adoption and prominence, and finally, a weighted scoring method to single out the most influential platforms. From this process, we derive valuable insights into the essential components of effective MLOps systems and provide a decision-making flowchart that simplifies platform selection. This framework provides hands-on guidance for organizations looking to initiate or enhance their MLOps strategies, whether they require an end-end solutions or specialized tools.
引用
收藏
页数:37
相关论文
共 50 条
  • [1] Decentralizing Machine Learning Operations using Web3 for IoT Platforms
    Wickstrom, John
    Westerlund, Magnus
    Raj, Emmanuel
    2022 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM 2022), 2022, : 238 - 245
  • [2] Landscape of machine learning evolution: privacy-preserving federated learning frameworks and tools
    Nguyen, Giang
    Sainz-Pardo Diaz, Judith
    Calatrava, Amanda
    Berberi, Lisana
    Lytvyn, Oleksandr
    Kozlov, Valentin
    Tran, Viet
    Molto, German
    Lopez Garcia, Alvaro
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 58 (02)
  • [3] Machine Learning for Machine Tools
    Sinkora, Ed
    MANUFACTURING ENGINEERING, 2023, 171 (02): : 68 - 75
  • [4] Scheduling operations on parallel machine tools
    Norman, Bryan A.
    Bean, James C.
    IIE Transactions (Institute of Industrial Engineers), 2000, 32 (05): : 449 - 460
  • [5] Scheduling operations on parallel machine tools
    Norman, BA
    Bean, JC
    IIE TRANSACTIONS, 2000, 32 (05) : 449 - 459
  • [6] On the Advancement of Project Management through a Flexible Integration of Machine Learning and Operations Research Tools
    Kanakaris, Nikos
    Karacapilidis, Nikos
    Lazanas, Alexis
    ICORES: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON OPERATIONS RESEARCH AND ENTERPRISE SYSTEMS, 2019, : 362 - 369
  • [7] Revealing processing stability landscape of organic solar cells with automated research platforms and machine learning
    Du, Xiaoyan
    Lueer, Larry
    Heumueller, Thomas
    Classen, Andrej
    Liu, Chao
    Berger, Christian
    Wagner, Jerrit
    Le Corre, Vincent M.
    Cao, Jiamin
    Xiao, Zuo
    Ding, Liming
    Forberich, Karen
    Li, Ning
    Hauch, Jens
    Brabec, Christoph J.
    INFOMAT, 2024, 6 (07)
  • [8] Performance Comparison of Machine Learning Platforms
    Roy, Asim
    Qureshi, Shiban
    Pande, Kartikeya
    Nair, Divitha
    Gairola, Kartik
    Jain, Pooja
    Singh, Suraj
    Sharma, Kirti
    Jagadale, Akshay
    Lin, Yi-Yang
    Sharma, Shashank
    Gotety, Ramya
    Zhang, Yuexin
    Tang, Ji
    Mehta, Tejas
    Sindhanuru, Hemanth
    Okafor, Nonso
    Das, Santak
    Gopal, Chidambara N.
    Rudraraju, Srinivasa B.
    Kakarlapudia, Avinash, V
    INFORMS JOURNAL ON COMPUTING, 2019, 31 (02) : 207 - 225
  • [9] E-learning platforms and telematic tools
    Gutierrez-Santiuste, Elba
    PROFESORADO-REVISTA DE CURRICULUM Y FORMACION DE PROFESORADO, 2011, 15 (01): : 330 - 333
  • [10] E-learning platforms and telematic tools
    Garcia Blanco, Miriam
    EDUCACION XX1, 2011, 14 (01): : 294 - 295