Geochemistry π: Automated Machine Learning Python']Python Framework for Tabular Data

被引:1
|
作者
ZhangZhou, J. [1 ]
He, Can [2 ]
Sun, Jianhao [3 ]
Zhao, Jianming [1 ]
Lyu, Yang [1 ]
Wang, Shengxin [4 ]
Zhao, Wenyu [1 ]
Li, Anzhou [1 ]
Ji, Xiaohui [5 ]
Agarwal, Anant [6 ]
机构
[1] Zhejiang Univ, Sch Earth Sci, Key Lab Geosci Big Data & Deep Resource Zhejiang P, Hangzhou, Peoples R China
[2] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[3] China Univ Geosci, Sch Earth Sci, Wuhan, Peoples R China
[4] Lanzhou Univ, Sch Earth Sci, Lanzhou, Peoples R China
[5] China Univ Geosci, Sch Informat Engn, Beijing, Peoples R China
[6] Nissan Motor Corp, Dept Data Sci, Yokohama, Japan
关键词
automated machine learning; !text type='Python']Python[!/text] framework; tabular data;
D O I
10.1029/2023GC011324
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Although machine learning (ML) has brought new insights into geochemistry research, its implementation is laborious and time-consuming. Here, we announce Geochemistry pi, an open-source automated ML Python framework. Geochemists only need to provide tabulated data and select the desired options to clean data and run ML algorithms. The process operates in a question-and-answer format, and thus does not require that users have coding experience. After either automatic or manual parameter tuning, the automated Python framework provides users with performance and prediction results for the trained ML model. Based on the scikit-learn library, Geochemistry pi has established a customized automated process for implementing classification, regression, dimensionality reduction, and clustering algorithms. The Python framework enables extensibility and portability by constructing a hierarchical pipeline architecture that separates data transmission from the algorithm application. The AutoML module is constructed using the Cost-Frugal Optimization and Blended Search Strategy hyperparameter search methods from the A Fast and Lightweight AutoML Library, and the model parameter optimization process is accelerated by the Ray distributed computing framework. The MLflow library is integrated into ML lifecycle management, which allows users to compare multiple trained models at different scales and manage the data and diagrams generated. In addition, the front-end and back-end frameworks are separated to build the web portal, which demonstrates the ML model and data science workflow through a user-friendly web interface. In summary, Geochemistry pi provides a Python framework for users and developers to accelerate their data mining efficiency with both online and offline operation options. Geochemistry pi is a helpful tool for scientists who work with geochemical data. One of its standout features is its simplicity. Scientists can use the tool to perform machine learning (ML) on the tabular data by answering a series of questions about what they want to discover. The tool does the rest by using advanced ML techniques to uncover insights from the data. Even scientists without coding skills can use Geochemistry pi effectively. This tool is built on a reliable library called scikit-learn, ensuring that it works well with different ML methods. It is also flexible, allowing researchers to customize it to fit their specific needs. Geochemistry pi separates data processing from ML tasks, making it adaptable and expandable. It includes features for continuous training and managing the entire ML process. To prove its effectiveness, Geochemistry pi was tested against previous geochemical studies in areas such as regression, classification, clustering, and dimensional reduction. The results showed that it could replicate the findings of these studies accurately. Accessible through a web portal or command line, Geochemistry pi is a valuable asset for geochemists and researchers looking to analyze large geochemical data sets. Open-source Python framework for machine learning applications in geochemistryAutomated pipeline for tabular dataQuestion-and-answer format obviates the need for coding experience
引用
收藏
页数:14
相关论文
共 50 条
  • [1] River: machine learning for streaming data in Python']Python
    Montiel, Jacob
    Halford, Max
    Mastelini, Saulo Martiello
    Bolmier, Geoffrey
    Sourty, Raphael
    Vaysse, Robin
    Zouitine, Adil
    Gomes, Heitor Murilo
    Read, Jesse
    Abdessalem, Talel
    Bifet, Albert
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22
  • [2] A Python']Python Framework for Exhaustive Machine Learning Algorithms and Features Evaluations
    Dubosson, Fabien
    Bromuri, Stefano
    Schumacher, Michael
    IEEE 30TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS IEEE AINA 2016, 2016, : 987 - 993
  • [3] Big Data and Machine Learning - Cloud and Python']Python Workshop
    Nguyen, Thuan L.
    AMCIS 2018 PROCEEDINGS, 2018,
  • [4] MLCatchUp: Automated Update of Deprecated Machine-Learning APIs in Python']Python
    Haryono, Stefanus A.
    Thung, Ferdian
    Lo, David
    Lawall, Julia
    Jiang, Lingxiao
    2021 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME 2021), 2021, : 584 - 588
  • [5] An Introduction to Machine Learning in Python']Python
    Clevert, D. -A.
    TOXICOLOGY LETTERS, 2023, 384 : S5 - S5
  • [6] Machine Learning in Python']Python Fundamentals
    Hernandez Aguilar, Jose Alberto
    Hernandez Perez, Yasmin
    2023 12TH INTERNATIONAL CONFERENCE ON SOFTWARE PROCESS IMPROVEMENT, CIMPS 2023, 2023, : 281 - 284
  • [7] Glycowork: A Python']Python package for glycan data science and machine learning
    Thomes, Luc
    Burkholz, Rebekka
    Bojar, Daniel
    GLYCOBIOLOGY, 2021, 31 (10) : 1240 - 1244
  • [8] SnapperML: A python']python-based framework to improve machine learning operations
    Molner, Antonio
    Carrillo-Perez, Francisco
    Guillen, Alberto
    SOFTWAREX, 2024, 26
  • [9] MLPro - An integrative middleware framework for standardized machine learning tasks in Python']Python
    Arend, Detlef
    Diprasetya, Mochammad Rizky
    Yuwono, Steve
    Schwung, Andreas
    SOFTWARE IMPACTS, 2022, 14
  • [10] Data science: Fundamentals and case studies, machine learning with Python']Python
    Morand, Elisabeth
    POPULATION, 2018, 73 (02): : 404 - 405