Geochemistry π: Automated Machine Learning Python']Python Framework for Tabular Data

被引:1
|
作者
ZhangZhou, J. [1 ]
He, Can [2 ]
Sun, Jianhao [3 ]
Zhao, Jianming [1 ]
Lyu, Yang [1 ]
Wang, Shengxin [4 ]
Zhao, Wenyu [1 ]
Li, Anzhou [1 ]
Ji, Xiaohui [5 ]
Agarwal, Anant [6 ]
机构
[1] Zhejiang Univ, Sch Earth Sci, Key Lab Geosci Big Data & Deep Resource Zhejiang P, Hangzhou, Peoples R China
[2] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[3] China Univ Geosci, Sch Earth Sci, Wuhan, Peoples R China
[4] Lanzhou Univ, Sch Earth Sci, Lanzhou, Peoples R China
[5] China Univ Geosci, Sch Informat Engn, Beijing, Peoples R China
[6] Nissan Motor Corp, Dept Data Sci, Yokohama, Japan
关键词
automated machine learning; !text type='Python']Python[!/text] framework; tabular data;
D O I
10.1029/2023GC011324
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Although machine learning (ML) has brought new insights into geochemistry research, its implementation is laborious and time-consuming. Here, we announce Geochemistry pi, an open-source automated ML Python framework. Geochemists only need to provide tabulated data and select the desired options to clean data and run ML algorithms. The process operates in a question-and-answer format, and thus does not require that users have coding experience. After either automatic or manual parameter tuning, the automated Python framework provides users with performance and prediction results for the trained ML model. Based on the scikit-learn library, Geochemistry pi has established a customized automated process for implementing classification, regression, dimensionality reduction, and clustering algorithms. The Python framework enables extensibility and portability by constructing a hierarchical pipeline architecture that separates data transmission from the algorithm application. The AutoML module is constructed using the Cost-Frugal Optimization and Blended Search Strategy hyperparameter search methods from the A Fast and Lightweight AutoML Library, and the model parameter optimization process is accelerated by the Ray distributed computing framework. The MLflow library is integrated into ML lifecycle management, which allows users to compare multiple trained models at different scales and manage the data and diagrams generated. In addition, the front-end and back-end frameworks are separated to build the web portal, which demonstrates the ML model and data science workflow through a user-friendly web interface. In summary, Geochemistry pi provides a Python framework for users and developers to accelerate their data mining efficiency with both online and offline operation options. Geochemistry pi is a helpful tool for scientists who work with geochemical data. One of its standout features is its simplicity. Scientists can use the tool to perform machine learning (ML) on the tabular data by answering a series of questions about what they want to discover. The tool does the rest by using advanced ML techniques to uncover insights from the data. Even scientists without coding skills can use Geochemistry pi effectively. This tool is built on a reliable library called scikit-learn, ensuring that it works well with different ML methods. It is also flexible, allowing researchers to customize it to fit their specific needs. Geochemistry pi separates data processing from ML tasks, making it adaptable and expandable. It includes features for continuous training and managing the entire ML process. To prove its effectiveness, Geochemistry pi was tested against previous geochemical studies in areas such as regression, classification, clustering, and dimensional reduction. The results showed that it could replicate the findings of these studies accurately. Accessible through a web portal or command line, Geochemistry pi is a valuable asset for geochemists and researchers looking to analyze large geochemical data sets. Open-source Python framework for machine learning applications in geochemistryAutomated pipeline for tabular dataQuestion-and-answer format obviates the need for coding experience
引用
收藏
页数:14
相关论文
共 50 条
  • [41] MDSubSampler: A Python']Python library for a posteriori sampling of important protein conformations, automated workflows for mutation engineering and data processing for machine learning prediction
    Oues, Namir
    Dantu, Sarath C.
    Patel, Riktaben J.
    Pandini, Alessandro
    BIOPHYSICAL JOURNAL, 2024, 123 (03) : 422A - 423A
  • [42] Automated bibliometric data generation in Python']Python from a bibliographic database
    Toaza, Bladimir
    Esztergar-Kiss, Domokos
    SOFTWARE IMPACTS, 2024, 19
  • [43] Transactional Python']Python for Durable Machine Learning: Vision, Challenges, and Feasibility
    Chockchowwat, Supawit
    Li, Zhaoheng
    Park, Yongjoo
    PROCEEDINGS OF THE SEVENTH WORKSHOP ON DATA MANAGEMENT FOR END-TO-END MACHINE LEARNING, DEEM, 2023,
  • [44] Ichor: A Python']Python library for computational chemistry data management and machine learning force field development
    Manchev, Yulian T.
    Burn, Matthew J.
    Popelier, Paul L. A.
    JOURNAL OF COMPUTATIONAL CHEMISTRY, 2024, 45 (32) : 2912 - 2928
  • [45] Assignment of Regioisomers Using Infrared Spectroscopy: A Python']Python Coding Exercise in Data Processing and Machine Learning
    Cahill, Samuel T.
    Young, Joseph E. B.
    Howe, Max
    Clark, Ryan
    Worrall, Andrew F.
    Stewart, Malcolm I.
    JOURNAL OF CHEMICAL EDUCATION, 2024, : 2925 - 2932
  • [46] NICHE: A Curated Dataset of Engineered Machine Learning Projects in Python']Python
    Widyasari, Ratnadira
    Yang, Zhou
    Thung, Ferdian
    Sim, Sheng Qin
    Wee, Fiona
    Lok, Camellia
    Phan, Jack
    Qi, Haodi
    Tan, Constance
    Tay, Qijin
    Lo, David
    2023 IEEE/ACM 20TH INTERNATIONAL CONFERENCE ON MINING SOFTWARE REPOSITORIES, MSR, 2023, : 62 - 66
  • [47] A TUTORIAL ON OBJECT RECOGNITION BY MACHINE LEARNING TECHNIQUES USING PYTHON']PYTHON
    Ruiz-Sarmiento, J. R.
    Monroy, J.
    Moreno, F. A.
    Gonzalez-Jimenez, J.
    13TH INTERNATIONAL TECHNOLOGY, EDUCATION AND DEVELOPMENT CONFERENCE (INTED2019), 2019, : 3321 - 3330
  • [48] MetaHistoSeg: A Python']Python Framework for Meta Learning in Histopathology Image Segmentation
    Yuan, Zheng
    Esteva, Andre
    Xu, Ran
    DEEP GENERATIVE MODELS, AND DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS, 2021, 13003 : 268 - 275
  • [49] Causal ML: Python']Python package for causal inference machine learning
    Zhao, Yang
    Liu, Qing
    SOFTWAREX, 2023, 21
  • [50] Leveraging machine learning for accurate DNBR prediction using python']python
    Mohsen, Mohamed Y. M.
    Al Meshari, Meshari
    Alzamil, Yasser
    Alhammad, Abdulrahman
    Alenazi, Khaled
    El-Taher, Atef
    Nagla, Tarek F.
    Abdel-Rahman, Mohamed A. E.
    NUCLEAR ENGINEERING AND TECHNOLOGY, 2025, 57 (07)