SnapperML: A python']python-based framework to improve machine learning operations

被引:1
|
作者
Molner, Antonio [1 ]
Carrillo-Perez, Francisco [2 ]
Guillen, Alberto [1 ]
机构
[1] Univ Granada, Comp Engn Automat & Robot Dept, Granada, Spain
[2] Stanford Univ, Stanford Ctr Biomed Informat Res BMIR, Sch Med, Stanford, CA USA
关键词
MLOps; Machine learning; Deep learning;
D O I
10.1016/j.softx.2024.101648
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Data Science has emerged as a vital discipline applicable across numerous industry sectors. However, achieving reproducibility in this field remains a challenging and unresolved problem. Additionally, transitioning trained models from development to production environments often proves to be a non-trivial task. In this study, we propose SnapperML, a comprehensive framework designed to address these issues by enabling practitioners to establish structured workflows that facilitate result reproducibility. Leveraging DevOps techniques, SnapperML ensures seamless model deployment from the lab to production, mitigating the risks associated with compatibility issues and model selection errors. The framework enables meticulous tracking of every aspect of model training, including hyperparameter selection, tuning, and distributed training on a server. By offering a suite of tools for model tracking and optimization, SnapperML presents a promising solution to the reproducibility challenge in the field of data science.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] QuaPy: A Python']Python-Based Framework for Quantification
    Moreo, Alejandro
    Esuli, Andrea
    Sebastiani, Fabrizio
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 4534 - 4543
  • [2] A Machine Learning Python']Python-Based Search Engine Optimization Audit Software
    Roumeliotis, Konstantinos I.
    Tselikas, Nikolaos D.
    [J]. INFORMATICS-BASEL, 2023, 10 (03):
  • [3] PYSCF: the Python']Python-based simulations of chemistry framework
    Sun, Qiming
    Berkelbach, Timothy C.
    Blunt, Nick S.
    Booth, George H.
    Guo, Sheng
    Li, Zhendong
    Liu, Junzi
    McClain, James D.
    Sayfutyarova, Elvira R.
    Sharma, Sandeep
    Wouters, Sebastian
    Chan, Garnet Kin-Lic
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL MOLECULAR SCIENCE, 2018, 8 (01)
  • [4] DeepMTP: A Python']Python-based deep learning framework for multi-target prediction
    Iliadis, Dimitrios
    De Baets, Bernard
    Waegeman, Willem
    [J]. SOFTWAREX, 2023, 23
  • [5] PySPH: A Python']Python-based Framework for Smoothed Particle Hydrodynamics
    Ramachandran, Prabhu
    Bhosale, Aditya
    Puri, Kunal
    Negi, Pawan
    Muta, Abhinav
    Dinesh, A.
    Menon, Dileep
    Govind, Rahul
    Sanka, Suraj
    Sebastian, Amal S.
    Sen, Ananyo
    Kaushik, Rohan
    Kumar, Anshuman
    Kurapati, Vikas
    Patil, Mrinalgouda
    Tavker, Deep
    Pandey, Pankaj
    Kaushik, Chandrashekhar
    Dutt, Arkopal
    Agarwal, Arpit
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2021, 47 (04):
  • [6] mango: A modular python']python-based agent simulation framework
    Schrage, Rico
    Sager, Jens
    Hoerding, Jan Philipp
    Holly, Stefanie
    [J]. SOFTWAREX, 2024, 27
  • [7] automan: A Python']Python-Based Automation Framework for Numerical Computing
    Ramachandran, Prabhu
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 2018, 20 (05) : 81 - 97
  • [8] Python']Python-based preprocessing for applying machine learning in breast cancer metastasis prediction.
    Rostom, Yousri A.
    Abd-El-Moneim, Salah-Eldin
    Labib, Nevine Makram
    Gharib, Samia
    Shaker, Marwa
    Mahmoud, Nayera
    [J]. JOURNAL OF CLINICAL ONCOLOGY, 2021, 39 (15)
  • [9] Analysing the Performance of Python']Python-Based Web Services with the VyPR Framework
    Dawes, Joshua Heneage
    Han, Marta
    Javed, Omar
    Reger, Giles
    Franzoni, Giovanni
    Pfeiffer, Andreas
    [J]. RUNTIME VERIFICATION (RV 2020), 2020, 12399 : 67 - 86
  • [10] ERAsim: A Flexible Python']Python-based Architectural Modeling and Simulation Framework
    Wasly, Saud
    [J]. 2020 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT AND ADVANCED SYSTEMS (ICIAS), 2021,