A deep learning-based imputation method for missing gaps in satellite aerosol products by fusing numerical model data

被引:1
|
作者
Liu, Ning [1 ]
Li, Yi [1 ]
Zang, Zengliang [1 ,2 ]
Hu, Yiwen [1 ]
Fang, Xin [3 ]
Lolli, Simone [4 ,5 ]
机构
[1] Natl Univ Def Technol, Coll Meteorol & Oceanog, Changsha 410003, Peoples R China
[2] High Impact Weather Key Lab CMA, Changsha 410003, Peoples R China
[3] Hunan City Univ, Sch Municipal & Geomat Engn, Yiyang 413000, Peoples R China
[4] CNR, Inst Methodol Environm Anal IMAA, Contrada S Loja snc, I-85050 Tito, PZ, Italy
[5] UPC, Dept Signal Theory & Commun, CommSensLab, E-08034 Barcelona, Spain
基金
中国国家自然科学基金;
关键词
Aerosol; Remote sensing; Missing gaps; Deep learning; Spatiotemporal imputation; OPTICAL DEPTH; AIR-POLLUTION; ALGORITHM; CLIMATE; HEALTH; VALIDATION; AERONET; CHINA;
D O I
10.1016/j.atmosenv.2024.120440
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Satellite-based aerosol optical depth (AOD) products are commonly used in various aerosol-related studies, such as aerosol pollution mapping and aerosol-climate interactions. However, these satellite AOD products often suffer from significant missing gaps due to cloud cover and limitations in the retrieval algorithm. To address this issue, some studies take advantage of real-time seamless simulation of numerical models and successfully fill in these gaps by establishing a regression relationship between satellite AOD and numerical model AOD. However, these previous studies usually use satellite AOD retrievals as the regression target, which limits the accuracy of the imputation results by the original accuracy of satellite AOD retrievals and also consumes a considerable amount of time. To overcome these limitations, this study proposes a spatiotemporal imputation model called BiConvRNN, which combines convolutional neural networks (CNN) and bidirectional recurrent neural networks (Bi-RNN). The model takes both satellite AOD retrievals and numerical model AOD data as input and utilizes the weighted mean squared error (MSE) loss function of multiple AOD datasets, e.g., ground-based data, satellite retrievals, and numerical simulation, as the optimization target to improve the imputation accuracy. The proposed model is evaluated using hourly COMS GOCI AOD products. In the independent test set, the AOD results generated by the Bi-ConvRNN model in the region containing GOCI AOD retrievals can break the accuracy of original GOCI AOD products with the accuracy improved from R2 = 0.70 [RMSE = 0.15] to R2 = 0.84 [RMSE = 0.11], and the filling accuracy, e.g. R2 = 0.79, [RMSE = 0.14], in the region without GOCI AOD retrievals are still better than those of the original GOCI AOD retrievals. Additionally, the Bi-ConvRNN model demonstrates satisfactory filling efficiency, requiring only 0.12 s to fill in the missing gaps of hourly GOCI AOD products per day. These results highlight the efficiency and reliability of the proposed model in filling the gaps in satellite AOD products, and the filled AOD results have great potential for further aerosol-related research.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Learning-Based Adaptive Imputation Method with kNN Algorithm for Missing Power Data
    Kim, Minkyung
    Park, Sangdon
    Lee, Joohyung
    Joo, Yongjae
    Choi, Jun Kyun
    [J]. ENERGIES, 2017, 10 (10)
  • [2] Satellite Data Transmission Method for Deep Learning-Based AutoEncoders
    Fan, YiLe
    Li, YuanPeng
    Chai, TianYi
    Ding, Dan
    [J]. 2021 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES FOR DISASTER MANAGEMENT (ICT-DM), 2021, : 38 - 42
  • [3] The Optimal Machine Learning-Based Missing Data Imputation for the Cox Proportional Hazard Model
    Guo, Chao-Yu
    Yang, Ying-Chen
    Chen, Yi-Hau
    [J]. FRONTIERS IN PUBLIC HEALTH, 2021, 9
  • [4] Handling missing values in healthcare data: A systematic review of deep learning-based imputation techniques
    Liu, Mingxuan
    Li, Siqi
    Yuan, Han
    Ong, Marcus Eng Hock
    Ning, Yilin
    Xie, Feng
    Saffari, Seyed Ehsan
    Shang, Yuqing
    Volovici, Victor
    Chakraborty, Bibhas
    Liu, Nan
    [J]. ARTIFICIAL INTELLIGENCE IN MEDICINE, 2023, 142
  • [5] Generating Hourly Fine Seamless Aerosol Optical Depth Products by Fusing Multiple Satellite and Numerical Model Data
    Zou, Bin
    Liu, Ning
    Li, Yi
    Zang, Zengliang
    Li, Sha
    Li, Shenxin
    Wu, Jian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [6] "Deep" Learning for Missing Value Imputation in Tables with Non-Numerical Data
    Biessmann, Felix
    Salinas, David
    Schelter, Sebastian
    Schmidt, Philipp
    Lange, Dustin
    [J]. CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 2017 - 2025
  • [7] Missing data imputation model for dam health monitoring based on mode decomposition and deep learning
    Song, Jintao
    Yang, Zhaodi
    Li, Xinru
    [J]. JOURNAL OF CIVIL STRUCTURAL HEALTH MONITORING, 2024, 14 (05) : 1111 - 1124
  • [8] A Deep Learning-Based Satellite Target Recognition Method Using Radar Data
    Lu, Wang
    Zhang, Yasheng
    Xu, Can
    Lin, Caiyong
    Huo, Yurong
    [J]. SENSORS, 2019, 19 (09)
  • [9] Modulo 9 model-based learning for missing data imputation
    Ngueilbaye, Alladoumbaye
    Wang, Hongzhi
    Mahamat, Daouda Ahmat
    Junaidu, Sahalu B.
    [J]. APPLIED SOFT COMPUTING, 2021, 103
  • [10] A Machine Learning-Based Missing Data Imputation with FHIR Interoperability Approach in Sepsis Prediction
    Toro Beltran, Cristian Fernando
    Villarreal Ibanez, Erick Daniel
    Milen Orejuela, Vivian
    Garcia Henao, John Anderson
    [J]. HIGH PERFORMANCE COMPUTING, CARLA 2022, 2022, 1660 : 116 - 130