TemproNet: A transformer-based deep learning model for seawater temperature prediction

被引:6
|
作者
Chen, Qiaochuan [1 ]
Cai, Candong [1 ]
Chen, Yaoran [2 ]
Zhou, Xi [2 ]
Zhang, Dan [2 ,3 ]
Peng, Yan [2 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Inst Artificial Intelligence, Collaborat Innovat Ctr Marine Artificial Intellige, Shanghai 200444, Peoples R China
[3] Minist Educ, Engn Res Ctr Unmanned Intelligent Marine Equipment, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformer; Satellite observation; Deep learning; Seawater temperature; SUBSURFACE TEMPERATURE; OCEAN;
D O I
10.1016/j.oceaneng.2023.116651
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Accurate prediction of seawater temperature is crucial for meteorological model understanding and climate change assessment. This study proposes TempreNet, a deep learning model based on a transformer and convolutional neural network, to accurately predict subsurface seawater temperature using satellite observations in the South China Sea. TemproNet uses multivariate sea surface observations such as sea level anomaly (SLA), sea surface temperature (SST), and sea surface wind (SSW) as model inputs, which employs a hierarchical transformer encoder to extract the multi -scale feature, uses a lightweight convolutional decoder to predict seawater temperature. We train and validate the model using the CMEMS temperature dataset and compare its accuracy with Attention-Unet, LightGMB, and ANN. Experimental results show that TemproNet has significantly outperformed other models with RMSE and R2 of 0.52 degrees C and 0.83 in a 32 -layer temperature profile prediction task over 200 m in the South China Sea. In addition, we fully demonstrate the error of our model in space, in time, and at different depths, showing the efficiency and stability of our model. The input sensitivity analysis showed that SST contributed more to predicting shallow water temperature, while SLA significantly impacted the prediction of mid -deep water temperature. The results of this study provide an innovative and reliable solution for seawater temperature prediction and have important implications for meteorological model understanding and climate change assessment.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] An Explainable Transformer-Based Deep Learning Model for the Prediction of Incident Heart Failure
    Rao, Shishir
    Li, Yikuan
    Ramakrishnan, Rema
    Hassaine, Abdelaali
    Canoy, Dexter
    Cleland, John
    Lukasiewicz, Thomas
    Salimi-Khorshidi, Gholamreza
    Rahimi, Kazem
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (07) : 3362 - 3372
  • [2] Transformer-Based Deep Learning Method for the Prediction of Ventilator Pressure
    Fan, Ruizhe
    [J]. 2022 IEEE 2ND INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SOFTWARE ENGINEERING (ICICSE 2022), 2022, : 25 - 28
  • [3] GIT: A Transformer-Based Deep Learning Model for Geoacoustic Inversion
    Feng, Sheng
    Zhu, Xiaoqian
    Ma, Shuqing
    Lan, Qiang
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (06)
  • [4] Transformer-based deep learning model for forced oscillation localization
    Matar, Mustafa
    Estevez, Pablo Gill
    Marchi, Pablo
    Messina, Francisco
    Elmoudi, Ramadan
    Wshah, Safwan
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 146
  • [5] Characterization of groundwater contamination: A transformer-based deep learning model
    Bai, Tao
    Tahmasebi, Pejman
    [J]. ADVANCES IN WATER RESOURCES, 2022, 164
  • [6] Incorporating heat budget dynamics in a Transformer-based deep learning model for skillful ENSO prediction
    Mu, Bin
    Cui, Yuehan
    Yuan, Shijin
    Qin, Bo
    [J]. NPJ CLIMATE AND ATMOSPHERIC SCIENCE, 2024, 7 (01):
  • [7] A transformer-based deep learning model for Persian moral sentiment analysis
    Karami, Behnam
    Bakouie, Fatemeh
    Gharibzadeh, Shahriar
    [J]. JOURNAL OF INFORMATION SCIENCE, 2023,
  • [8] Automatic identification of suicide notes with a transformer-based deep learning model
    Zhang, Tianlin
    Schoene, Annika M.
    Ananiadou, Sophia
    [J]. INTERNET INTERVENTIONS-THE APPLICATION OF INFORMATION TECHNOLOGY IN MENTAL AND BEHAVIOURAL HEALTH, 2021, 25
  • [9] Prediction of Electric Vehicles Charging Demand: A Transformer-Based Deep Learning Approach
    Koohfar, Sahar
    Woldemariam, Wubeshet
    Kumar, Amit
    [J]. SUSTAINABILITY, 2023, 15 (03)
  • [10] VGG-TSwinformer: Transformer-based deep learning model for early Alzheimer?s disease prediction
    Hu, Zhentao
    Wang, Zheng
    Jin, Yong
    Hou, Wei
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 229