Geochemistry π: Automated Machine Learning Python']Python Framework for Tabular Data

被引:1
|
作者
ZhangZhou, J. [1 ]
He, Can [2 ]
Sun, Jianhao [3 ]
Zhao, Jianming [1 ]
Lyu, Yang [1 ]
Wang, Shengxin [4 ]
Zhao, Wenyu [1 ]
Li, Anzhou [1 ]
Ji, Xiaohui [5 ]
Agarwal, Anant [6 ]
机构
[1] Zhejiang Univ, Sch Earth Sci, Key Lab Geosci Big Data & Deep Resource Zhejiang P, Hangzhou, Peoples R China
[2] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[3] China Univ Geosci, Sch Earth Sci, Wuhan, Peoples R China
[4] Lanzhou Univ, Sch Earth Sci, Lanzhou, Peoples R China
[5] China Univ Geosci, Sch Informat Engn, Beijing, Peoples R China
[6] Nissan Motor Corp, Dept Data Sci, Yokohama, Japan
关键词
automated machine learning; !text type='Python']Python[!/text] framework; tabular data;
D O I
10.1029/2023GC011324
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Although machine learning (ML) has brought new insights into geochemistry research, its implementation is laborious and time-consuming. Here, we announce Geochemistry pi, an open-source automated ML Python framework. Geochemists only need to provide tabulated data and select the desired options to clean data and run ML algorithms. The process operates in a question-and-answer format, and thus does not require that users have coding experience. After either automatic or manual parameter tuning, the automated Python framework provides users with performance and prediction results for the trained ML model. Based on the scikit-learn library, Geochemistry pi has established a customized automated process for implementing classification, regression, dimensionality reduction, and clustering algorithms. The Python framework enables extensibility and portability by constructing a hierarchical pipeline architecture that separates data transmission from the algorithm application. The AutoML module is constructed using the Cost-Frugal Optimization and Blended Search Strategy hyperparameter search methods from the A Fast and Lightweight AutoML Library, and the model parameter optimization process is accelerated by the Ray distributed computing framework. The MLflow library is integrated into ML lifecycle management, which allows users to compare multiple trained models at different scales and manage the data and diagrams generated. In addition, the front-end and back-end frameworks are separated to build the web portal, which demonstrates the ML model and data science workflow through a user-friendly web interface. In summary, Geochemistry pi provides a Python framework for users and developers to accelerate their data mining efficiency with both online and offline operation options. Geochemistry pi is a helpful tool for scientists who work with geochemical data. One of its standout features is its simplicity. Scientists can use the tool to perform machine learning (ML) on the tabular data by answering a series of questions about what they want to discover. The tool does the rest by using advanced ML techniques to uncover insights from the data. Even scientists without coding skills can use Geochemistry pi effectively. This tool is built on a reliable library called scikit-learn, ensuring that it works well with different ML methods. It is also flexible, allowing researchers to customize it to fit their specific needs. Geochemistry pi separates data processing from ML tasks, making it adaptable and expandable. It includes features for continuous training and managing the entire ML process. To prove its effectiveness, Geochemistry pi was tested against previous geochemical studies in areas such as regression, classification, clustering, and dimensional reduction. The results showed that it could replicate the findings of these studies accurately. Accessible through a web portal or command line, Geochemistry pi is a valuable asset for geochemists and researchers looking to analyze large geochemical data sets. Open-source Python framework for machine learning applications in geochemistryAutomated pipeline for tabular dataQuestion-and-answer format obviates the need for coding experience
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Scikit-learn: Machine Learning in Python']Python
    Pedregosa, Fabian
    Varoquaux, Gaeel
    Gramfort, Alexandre
    Michel, Vincent
    Thirion, Bertrand
    Grisel, Olivier
    Blondel, Mathieu
    Prettenhofer, Peter
    Weiss, Ron
    Dubourg, Vincent
    Vanderplas, Jake
    Passos, Alexandre
    Cournapeau, David
    Brucher, Matthieu
    Perrot, Matthieu
    Duchesnay, Edouard
    JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 : 2825 - 2830
  • [22] Interchanging Java']Java-Python']Python Data with Applications in Machine Learning Solutions
    Furtuna, Titus Felix
    Vinte, Claudiu
    Proscanu, Cosmin
    EDUCATION, RESEARCH AND BUSINESS TECHNOLOGIES, 2023, 321 : 329 - 342
  • [23] SPAM: Simplifying Python']Python for Approaching Machine Learning
    Rosiene, Joel A.
    Rosiene, Carolyn Pe
    2020 IEEE FRONTIERS IN EDUCATION CONFERENCE (FIE 2020), 2020,
  • [24] secml: Secure and explainable machine learning in Python']Python
    Pintor, Maura
    Demetrio, Luca
    Sotgiu, Angelo
    Melis, Marco
    Demontis, Ambra
    Biggio, Battista
    SOFTWAREX, 2022, 18
  • [25] PyCIM: A Python']Python Framework for the Dynamics of Coherent Ising Machine
    Li, Peixiang
    Cheng, Hao
    Liu, Yingwen
    Wang, Dongyang
    Wu, Junjie
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT X, ICIC 2024, 2024, 14871 : 194 - 207
  • [26] A Python']Python framework for microphone array data processing
    Sarradj, Ennes
    Herold, Gert
    APPLIED ACOUSTICS, 2017, 116 : 50 - 58
  • [27] Machine learning, deep learning and Python']Python language in field of geology
    Zhou YongZhang
    Wang Jun
    Zuo RenGuang
    Xiao Fan
    Shen WenJie
    Wang ShuGong
    ACTA PETROLOGICA SINICA, 2018, 34 (11) : 3173 - 3178
  • [28] Deeptime: a Python']Python library for machine learning dynamical models from time series data
    Hoffmann, Moritz
    Scherer, Martin
    Hempel, Tim
    Mardt, Andreas
    de Silva, Brian
    Husic, Brooke E.
    Klus, Stefan
    Wu, Hao
    Kutz, Nathan
    Brunton, Steven L.
    Noe, Frank
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (01):
  • [29] Sentiment Analysis using Machine Learning Techniques on Python']Python
    Rathee, Nisha
    Joshi, Nikita
    Kaur, Jaspreet
    PROCEEDINGS OF THE 2018 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS), 2018, : 779 - 785
  • [30] mOWL: Python']Python library for machine learning with biomedical ontologies
    Zhapa-Camacho, Fernando
    Kulmanov, Maxat
    Hoehndorf, Robert
    BIOINFORMATICS, 2023, 39 (01)