Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools

被引:98
|
作者
Anh Truong [1 ]
Walters, Austin [1 ]
Goodsitt, Jeremy [1 ]
Hines, Keegan [1 ]
Bruss, C. Bayan [1 ]
Farivar, Reza [1 ,2 ]
机构
[1] Capital One, Appl Res, Ctr Machine Learning, Mclean, VA 22102 USA
[2] Univ Illinois, Dept Comp Sci, 1304 W Springfield Ave, Urbana, IL 61801 USA
关键词
AutoML; automated machine learning; driverless AI; model selection; hyperparameter optimization;
D O I
10.1109/ICTAI.2019.00209
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers remains a fundamental challenge. Automated machine learning (AutoML) has emerged as a way to save time and effort on repetitive tasks in ML pipelines, such as data pre-processing, feature engineering, model selection, hyperparameter optimization, and prediction result analysis. In this paper, we investigate the current state of AutoML tools aiming to automate these tasks. We conduct various evaluations of the tools on many datasets, in different data segments, to examine their performance, and compare their advantages and disadvantages on different test cases.
引用
收藏
页码:1471 / 1479
页数:9
相关论文
共 50 条
  • [21] Towards Automated Auditing with Machine Learning
    Sifa, Rafet
    Ladi, Anna
    Pielka, Maren
    Ramamurthy, Rajkumar
    Hillebrand, Lars
    Kirsch, Birgit
    Biesner, David
    Stenzel, Robin
    Bell, Thiago
    Luebbering, Max
    Nuetten, Ulrich
    Bauckhage, Christian
    Warning, Ulrich
    Fuerst, Benedikt
    Khameneh, Tim Dilmaghani
    Thom, Daniel
    Huseynov, Ilgar
    Kahlert, Roland
    Schlums, Jennifer
    Ismail, Hisham
    Kliem, Bernd
    Loitz, Ruediger
    [J]. DOCENG'19: PROCEEDINGS OF THE ACM SYMPOSIUM ON DOCUMENT ENGINEERING 2019, 2019,
  • [22] Trust in AutoML: Exploring Information Needs for Establishing Trust in Automated Machine Learning Systems
    Drozdal, Jaimie
    Weisz, Justin
    Wang, Dakuo
    Dass, Gaurav
    Yao, Bingsheng
    Zhao, Changruo
    Muller, Michael
    Ju, Lin
    Su, Hui
    [J]. PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, IUI 2020, 2020, : 297 - 307
  • [23] From Conventional Machine Learning to AutoML
    Weng, Ziqiao
    [J]. 2019 3RD INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING AND ARTIFICIAL INTELLIGENCE (CCEAI 2019), 2019, 1207
  • [24] Author Correction: Hierarchical automated machine learning (AutoML) for advanced unconventional reservoir characterization
    Yousef Mubarak
    Ardiansyah Koeshidayatullah
    [J]. Scientific Reports, 13 (1)
  • [25] On Machine Learning Approaches for Automated Log Management
    Harutyunyan, Ashot N.
    Poghosyan, Arnak, V
    Grigoryan, Naira M.
    Hovhannisyan, Narek A.
    Kushmerick, Nicholas
    [J]. JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2019, 25 (08) : 925 - 945
  • [26] A Comparison of Automated Machine Learning Tools for Predicting Energy Building Consumption in Smart Cities
    Soares, Daniela
    Pereira, Pedro Jose
    Cortez, Paulo
    Goncalves, Carlos
    [J]. PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2023, PT I, 2023, 14115 : 311 - 322
  • [27] Machine Learning Models for Slope Stability Classification of Circular Mode Failure: An Updated Database and Automated Machine Learning (AutoML) Approach
    Ma, Junwei
    Jiang, Sheng
    Liu, Zhiyang
    Ren, Zhiyuan
    Lei, Dongze
    Tan, Chunhai
    Guo, Haixiang
    [J]. SENSORS, 2022, 22 (23)
  • [28] Towards the Automated Composition of Machine Learning Services
    Mohr, Felix
    Wever, Marcel
    Hullermeier, Eyke
    Faez, Amin
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (IEEE SCC 2018), 2018, : 241 - 244
  • [29] An Empirical Study on the Usage of Automated Machine Learning Tools
    Majidi, Forough
    Openja, Moses
    Khomh, Foutse
    Li, Heng
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME 2022), 2022, : 59 - 70
  • [30] Automated Machine Learning and Explainable AI (AutoML-XAI) for Metabolomics: Improving Cancer Diagnostics
    Bifarin, Olatomiwa O.
    Fernandez, Facundo M.
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR MASS SPECTROMETRY, 2024, 35 (06) : 1089 - 1100