Orthrus: multi-scale land cover mapping from satellite image time series via 2D encoding and convolutional neural network

被引:0
|
作者
Abidi, Azza [1 ,2 ]
Ienco, Dino [2 ,3 ]
Ben Abbes, Ali [1 ]
Farah, Imed Riadh [1 ]
机构
[1] RIADI Laboratory, National School of Computer Science, Manouba,2010, Tunisia
[2] UMR TETIS, INRAE, University of Montpellier, Montpellier,34000, France
[3] INRIA, Montpellier,34000, France
关键词
Deep learning; Pixel–object classification; Convolutional neural networks (CNNs); Multivariate time series; classification; 2D encoding representation; Land use/land cover;
D O I
10.1007/s00521-024-10186-2
中图分类号
学科分类号
摘要
With the advent of modern Earth observation (EO) systems, the opportunity of collecting satellite image time series (SITS) provides valuable insights to monitor spatiotemporal dynamics. Within this context, accurate land use/land cover (LULC) mapping plays a pivotal role in supporting territorial management and facilitating informed decision-making processes. However, traditional pixel-based and object-based classification methods often face challenges to effectively exploit spectral and spatial information. In this study, we propose Orthrus, a novel approach that fuses multi-scale information for enhanced LULC mapping. The proposed approach exploits several 2D encoding techniques to encode times series information into imagery. The resulting image is leveraged as input to a standard convolutional neural network (CNN) image classifier to cope with the downstream classification task. The evaluations on two real-world benchmarks, namely Dordogne and Reunion-Island, demonstrated the quality of Orthrus over state-of-the-art techniques from the field of land cover mapping based on SITS data. More precisely, Orthrus exhibits an enhancement of more than 3.5 accuracy points compared to the best competing approach on the Dordogne benchmark, and surpasses the best competing approach on the Reunion-Island dataset by over 3 accuracy points.
引用
收藏
页码:19247 / 19265
页数:18
相关论文
共 50 条
  • [41] Improving Feature Learning in Remote Sensing Images Using an Integrated Deep Multi-Scale 3D/2D Convolutional Network
    Tinega, Haron C. C.
    Chen, Enqing
    Nyasaka, Divinah O. O.
    REMOTE SENSING, 2023, 15 (13)
  • [42] Convolutional Neural Network-Based Land Cover Classification Using 2-D Spectral Reflectance Curve Graphs With Multitemporal Satellite Imagery
    Kim, Miae
    Lee, Junghee
    Han, Daehyeon
    Shin, Minso
    Im, Jungho
    Lee, Junghye
    Quackenbush, Lindi J.
    Gu, Zhu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (12) : 4604 - 4617
  • [43] AMSASeg: An Attention-Based Multi-Scale Atrous Convolutional Neural Network for Real-Time Object Segmentation From 3D Point Cloud
    Kim, Moogab
    Ilyas, Naveed
    Kim, Kiseon
    IEEE ACCESS, 2021, 9 : 70789 - 70796
  • [44] Implementation for Fetal ECG Detection from Multi-channel Abdominal Recordings with 2D Convolutional Neural Network
    Yu-Ching Ting
    Fang-Wen Lo
    Pei-Yun Tsai
    Journal of Signal Processing Systems, 2021, 93 : 1101 - 1113
  • [45] Implementation for Fetal ECG Detection from Multi-channel Abdominal Recordings with 2D Convolutional Neural Network
    Ting, Yu-Ching
    Lo, Fang-Wen
    Tsai, Pei-Yun
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2021, 93 (09): : 1101 - 1113
  • [46] A Multi-Mode Convolutional Neural Network to reconstruct satellite-derived chlorophyll-a time series in the global ocean from physical drivers
    Roussillon, Joana
    Fablet, Ronan
    Gorgues, Thomas
    Drumetz, Lucas
    Littaye, Jean
    Martinez, Elodie
    FRONTIERS IN MARINE SCIENCE, 2023, 10
  • [47] Whole Tumor Segmentation from Brain MR images using Multi-view 2D Convolutional Neural Network
    Lahoti, Ritu
    Vengalil, Sunil Kumar
    Venkategowda, Punith B.
    Sinha, Neelam
    Reddy, Vinod Veera
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 4111 - 4114
  • [48] Detection of dental diseases from radiographic 2d dental image using hybrid graph-cut technique and convolutional neural network
    Al Kheraif, Abdulaziz A.
    Wahba, Ashraf A.
    Fouad, H.
    MEASUREMENT, 2019, 146 : 333 - 342
  • [49] A time-multiplexed neural network framework for enhancing focal cues in multi-depth 3D holographic displays from 2D image input
    Liang, Li
    Wang, Zhuang
    Wang, Yue
    Liu, Yuan
    Wang, Zi
    Feng, Qibin
    Lv, Guoqiang
    OPTICS AND LASERS IN ENGINEERING, 2025, 186
  • [50] Fast Fully Automatic Segmentation of the Severely Abnormal Human Right Ventricle from Cardiovascular Magnetic Resonance Images using a Multi-scale 3D Convolutional Neural Network
    Giannakidis, Archontis
    Kamnitsas, Konstantinos
    Spadotto, Veronica
    Keegan, Jennifer
    Smith, Gillian
    Glocker, Ben
    Rueckert, Daniel
    Ernst, Sabine
    Gatzoulis, Michael A.
    Pennell, Dudley J.
    Babu-Narayan, Sonya
    Firmin, David N.
    2016 12TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS (SITIS), 2016, : 42 - 46