Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools

被引:98
|
作者
Anh Truong [1 ]
Walters, Austin [1 ]
Goodsitt, Jeremy [1 ]
Hines, Keegan [1 ]
Bruss, C. Bayan [1 ]
Farivar, Reza [1 ,2 ]
机构
[1] Capital One, Appl Res, Ctr Machine Learning, Mclean, VA 22102 USA
[2] Univ Illinois, Dept Comp Sci, 1304 W Springfield Ave, Urbana, IL 61801 USA
关键词
AutoML; automated machine learning; driverless AI; model selection; hyperparameter optimization;
D O I
10.1109/ICTAI.2019.00209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers remains a fundamental challenge. Automated machine learning (AutoML) has emerged as a way to save time and effort on repetitive tasks in ML pipelines, such as data pre-processing, feature engineering, model selection, hyperparameter optimization, and prediction result analysis. In this paper, we investigate the current state of AutoML tools aiming to automate these tasks. We conduct various evaluations of the tools on many datasets, in different data segments, to examine their performance, and compare their advantages and disadvantages on different test cases.
引用
收藏
页码:1471 / 1479
页数:9
相关论文
共 50 条
  • [1] Leveraging Automated Machine Learning for Text Classification: Evaluation of AutoML Tools and Comparison with Human Performance
    Blohm, Matthias
    Hanussek, Marc
    Kintz, Maximilien
    [J]. ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2021, : 1131 - 1136
  • [2] A Comparison of AutoML Tools for Machine Learning, Deep Learning and XGBoost
    Ferreira, Luis
    Pilastri, Andre
    Martins, Carlos Manuel
    Pires, Pedro Miguel
    Cortez, Paulo
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Comparison of Automated Machine Learning (AutoML) Tools for Epileptic Seizure Detection Using Electroencephalograms (EEG)
    Lenkala, Swetha
    Marry, Revathi
    Gopovaram, Susmitha Reddy
    Akinci, Tahir Cetin
    Topsakal, Oguzhan
    [J]. COMPUTERS, 2023, 12 (10)
  • [4] Evaluating the Performance of Automated Machine Learning (AutoML) Tools for Heart Disease Diagnosis and Prediction
    Paladino, Lauren M.
    Hughes, Alexander
    Perera, Alexander
    Topsakal, Oguzhan
    Akinci, Tahir Cetin
    [J]. AI, 2023, 4 (04) : 1036 - 1058
  • [5] A Review on Automated Machine Learning (AutoML) Systems
    Nagarajah, Thiloshon
    Poravi, Guhanathan
    [J]. 2019 IEEE 5TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2019,
  • [6] Power Transformer Fault Detection: A Comparison of Standard Machine Learning and autoML Approaches
    Santamaria-Bonfil, Guillermo
    Arroyo-Figueroa, Gustavo
    Zuniga-Garcia, Miguel A.
    Ramos, Carlos Gustavo Azcarraga
    Bassam, Ali
    [J]. ENERGIES, 2024, 17 (01)
  • [7] CO-AutoML: An Optimizable Automated Machine Learning System
    Wang, Chunnan
    Wang, Hongzhi
    Xu, Bo
    Song, Xintong
    Shi, Xiangyu
    Bao, Yuhao
    Zheng, Bo
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT III, 2022, : 509 - 513
  • [8] Benchmarking Automated Machine Learning (AutoML) Frameworks for Object Detection
    de Oliveira, Samuel
    Topsakal, Oguzhan
    Toker, Onur
    [J]. INFORMATION, 2024, 15 (01)
  • [9] Structure Learning and Hyperparameter Optimization Using an Automated Machine Learning (AutoML) Pipeline
    Filippou, Konstantinos
    Aifantis, George
    Papakostas, George A.
    Tsekouras, George E.
    [J]. INFORMATION, 2023, 14 (04)
  • [10] Automated Machine Learning (AutoML) for All Business Majors and Levels Workshop
    Larsen, Kai R.
    [J]. AMCIS 2018 PROCEEDINGS, 2018,