A canonical model for seasonal climate prediction using Big Data

被引:1
|
作者
Ramos, M. P. [1 ,2 ]
Tasinaffo, P. M. [1 ]
Cunha, A. M. [1 ]
Silva, D. A. [1 ]
Goncalves, G. S. [1 ]
Dias, L. A., V [1 ]
机构
[1] Brazilian Aeronaut Inst Technol, Comp & Elect Engn Grad Program, Sao Jose Dos Campos, SP, Brazil
[2] Brazilian Inst Space Res, Ctr Weather Forecasting & Climate Studies, Cachoeira Paulista, SP, Brazil
关键词
Big Data; Hadoop; Hive; MapReduce; Seasonal climate prediction; Atmospheric numerical model; PREDICTABILITY;
D O I
10.1186/s40537-022-00580-9
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This article addresses the elaboration of a canonical model, involving methods, techniques, metrics, tools, and Big Data, applied to the knowledge of seasonal climate prediction, aiming at greater dynamics, speed, conciseness, and scalability. The proposed model was hosted in an environment capable of integrating different types of meteorological data and centralizing data stores. The seasonal climate prediction method called M-PRECLIS was designed and developed for practical application. The usability and efficiency of the proposed model was tested through a case study that made use of operational data generated by an atmospheric numerical model of the climate area found in the supercomputing environment of the Center for Weather Forecasting and Climate Studies linked to the Brazilian Institute for Space Research. The seasonal climate prediction uses ensemble members method to work and the main Big Data technologies used for data processing were: Python language, Apache Hadoop, Apache Hive, and the Optimized Row Columnar (ORC) file format. The main contributions of this research are the canonical model, its modules and internal components, the proposed method M-PRECLIS, and its use in a case study. After applying the model to a practical and real experiment, it was possible to analyze the results obtained and verify: the consistency of the model by the output images, the code complexity, the performance, and also to perform the comparison with related works. Thus, it was found that the proposed canonical model, based on the best practices of Big Data, is a viable alternative that can guide new paths to be followed.
引用
收藏
页数:25
相关论文
共 50 条
  • [21] Hybrid Data Warehouse Model for Climate Big Data Analysis
    Doreswamy
    Gad, Ibrahim
    Manjunatha, B. R.
    PROCEEDINGS OF 2017 IEEE INTERNATIONAL CONFERENCE ON CIRCUIT ,POWER AND COMPUTING TECHNOLOGIES (ICCPCT), 2017,
  • [22] Development of Climate & Environment Data System for Big Data from Climate Model Simulations
    Lee, Jae-Hee
    Sung, Hyun Min
    Won, Sangho
    Lee, Johan
    Byun, Young-Hwa
    ATMOSPHERE-KOREA, 2019, 29 (01): : 75 - 86
  • [23] A New Transient Voltage Stability Prediction Model using Big Data Analysis
    Zhao, Bingbing
    Cao, Junwei
    Zhu, Ziyu
    Zhang, Huaying
    2016 IEEE INNOVATIVE SMART GRID TECHNOLOGIES - ASIA (ISGT-ASIA), 2016, : 1065 - 1069
  • [24] A Floating Population Prediction Model in Travel Spots using Weather Big Data
    Lee, Kyungmin
    Hong, Bonghee
    Lee, Jiwan
    Jang, Yangja
    PROCEEDINGS 2015 IEEE FIFTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING BDCLOUD 2015, 2015, : 118 - 124
  • [25] Stock Price Prediction using Artificial Neural Model: An Application of Big Data
    Shastri, Malav
    Roy, Sudipta
    Mittal, Mamta
    EAI ENDORSED TRANSACTIONS ON SCALABLE INFORMATION SYSTEMS, 2019, 6 (20) : 1 - 8
  • [26] A Prediction Model based on Big Data Analysis Using Hybrid FCM Clustering
    Yang, Seokhwan
    Kim, Jaechun
    Chung, Mokdong
    2014 9TH INTERNATIONAL CONFERENCE FOR INTERNET TECHNOLOGY AND SECURED TRANSACTIONS (ICITST), 2014, : 337 - 339
  • [27] A merged machine learning model for seasonal climate prediction in China
    Danwei QIAN
    Yanyan HUANG
    Huijun WANG
    Science China Earth Sciences, 2025, 68 (05) : 1469 - 1484
  • [28] Prediction of crop yield using big data
    Wu Fan
    Chen Chong
    Guo Xiaoling
    Yu Hua
    Wang Juyun
    2015 8TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2015, : 255 - 260
  • [29] Seasonal prediction of the Indian summer monsoon rainfall using canonical correlation analysis of the NCMRWF global model products
    Sinha, P.
    Mohanty, U. C.
    Kar, S. C.
    Dash, S. K.
    Robertson, A. W.
    Tippett, M. K.
    INTERNATIONAL JOURNAL OF CLIMATOLOGY, 2013, 33 (07) : 1601 - 1614
  • [30] Examination of multi-model ensemble seasonal prediction methods using a simple climate system
    In-Sik Kang
    Jin Ho Yoo
    Climate Dynamics, 2006, 26 : 285 - 294