A deep learning-based imputation method for missing gaps in satellite aerosol products by fusing numerical model data

被引:1
|
作者
Liu, Ning [1 ]
Li, Yi [1 ]
Zang, Zengliang [1 ,2 ]
Hu, Yiwen [1 ]
Fang, Xin [3 ]
Lolli, Simone [4 ,5 ]
机构
[1] Natl Univ Def Technol, Coll Meteorol & Oceanog, Changsha 410003, Peoples R China
[2] High Impact Weather Key Lab CMA, Changsha 410003, Peoples R China
[3] Hunan City Univ, Sch Municipal & Geomat Engn, Yiyang 413000, Peoples R China
[4] CNR, Inst Methodol Environm Anal IMAA, Contrada S Loja snc, I-85050 Tito, PZ, Italy
[5] UPC, Dept Signal Theory & Commun, CommSensLab, E-08034 Barcelona, Spain
基金
中国国家自然科学基金;
关键词
Aerosol; Remote sensing; Missing gaps; Deep learning; Spatiotemporal imputation; OPTICAL DEPTH; AIR-POLLUTION; ALGORITHM; CLIMATE; HEALTH; VALIDATION; AERONET; CHINA;
D O I
10.1016/j.atmosenv.2024.120440
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Satellite-based aerosol optical depth (AOD) products are commonly used in various aerosol-related studies, such as aerosol pollution mapping and aerosol-climate interactions. However, these satellite AOD products often suffer from significant missing gaps due to cloud cover and limitations in the retrieval algorithm. To address this issue, some studies take advantage of real-time seamless simulation of numerical models and successfully fill in these gaps by establishing a regression relationship between satellite AOD and numerical model AOD. However, these previous studies usually use satellite AOD retrievals as the regression target, which limits the accuracy of the imputation results by the original accuracy of satellite AOD retrievals and also consumes a considerable amount of time. To overcome these limitations, this study proposes a spatiotemporal imputation model called BiConvRNN, which combines convolutional neural networks (CNN) and bidirectional recurrent neural networks (Bi-RNN). The model takes both satellite AOD retrievals and numerical model AOD data as input and utilizes the weighted mean squared error (MSE) loss function of multiple AOD datasets, e.g., ground-based data, satellite retrievals, and numerical simulation, as the optimization target to improve the imputation accuracy. The proposed model is evaluated using hourly COMS GOCI AOD products. In the independent test set, the AOD results generated by the Bi-ConvRNN model in the region containing GOCI AOD retrievals can break the accuracy of original GOCI AOD products with the accuracy improved from R2 = 0.70 [RMSE = 0.15] to R2 = 0.84 [RMSE = 0.11], and the filling accuracy, e.g. R2 = 0.79, [RMSE = 0.14], in the region without GOCI AOD retrievals are still better than those of the original GOCI AOD retrievals. Additionally, the Bi-ConvRNN model demonstrates satisfactory filling efficiency, requiring only 0.12 s to fill in the missing gaps of hourly GOCI AOD products per day. These results highlight the efficiency and reliability of the proposed model in filling the gaps in satellite AOD products, and the filled AOD results have great potential for further aerosol-related research.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Temporal and spatial satellite data augmentation for deep learning-based rainfall nowcasting
    Yesilkoy, Ozlem Baydaroglu
    Demir, Ibrahim
    [J]. JOURNAL OF HYDROINFORMATICS, 2024, 26 (03) : 589 - 607
  • [22] A Deep Learning-Based Reliability Model for Complex Survival Data
    Aminisharifabad, Mohammad
    Yang, Qingyu
    Wu, Xin
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2021, 70 (01) : 73 - 81
  • [23] A novel machine learning-based imputation strategy for missing data in step-stress accelerated degradation test
    Li, Yaqiu
    Zhou, Qijie
    Fan, Ye
    Pan, Guangze
    Dai, Zongbei
    Lei, Baimao
    [J]. HELIYON, 2024, 10 (04)
  • [24] The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems
    Weinan E
    Bing Yu
    [J]. Communications in Mathematics and Statistics, 2018, 6 : 1 - 12
  • [25] The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems
    Weinan, E.
    Yu, Bing
    [J]. COMMUNICATIONS IN MATHEMATICS AND STATISTICS, 2018, 6 (01) : 1 - 12
  • [26] A Robust Deep Learning-Based Damage Identification Approach for SHM Considering Missing Data
    Deng, Fan
    Tao, Xiaoming
    Wei, Pengxiang
    Wei, Shiyin
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [27] MACHINE LEARNING-BASED MODEL BIAS CORRECTION BY FUSING CAE DATA WITH TEST DATA FOR VEHICLE CRASHWORTHINESS
    Zeng, Jice
    Zhao, Ying
    Li, Guosong
    Gao, Zhenyan
    Li, Yang
    Barbat, Saeed
    Hu, Zhen
    [J]. PROCEEDINGS OF ASME 2023 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2023, VOL 3B, 2023,
  • [28] Deep learning-based air temperature mapping by fusing remote sensing, station, simulation and socioeconomic data
    Shen, Huanfeng
    Jiang, Yun
    Li, Tongwen
    Cheng, Qing
    Zeng, Chao
    Zhang, Liangpei
    [J]. REMOTE SENSING OF ENVIRONMENT, 2020, 240
  • [29] Deep transfer learning-based damage detection of composite structures by fusing monitoring data with physical mechanism
    Liu, Cheng
    Xu, Xuebing
    Wu, Jun
    Zhu, Haiping
    Wang, Chao
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [30] Deep learning-based phenotype imputation on population-scale biobank data increases genetic discoveries
    Ulzee An
    Ali Pazokitoroudi
    Marcus Alvarez
    Lianyun Huang
    Silviu Bacanu
    Andrew J. Schork
    Kenneth Kendler
    Päivi Pajukanta
    Jonathan Flint
    Noah Zaitlen
    Na Cai
    Andy Dahl
    Sriram Sankararaman
    [J]. Nature Genetics, 2023, 55 : 2269 - 2276