Orthrus: multi-scale land cover mapping from satellite image time series via 2D encoding and convolutional neural network

被引:0
|
作者
Abidi, Azza [1 ,2 ]
Ienco, Dino [2 ,3 ]
Ben Abbes, Ali [1 ]
Farah, Imed Riadh [1 ]
机构
[1] RIADI Laboratory, National School of Computer Science, Manouba,2010, Tunisia
[2] UMR TETIS, INRAE, University of Montpellier, Montpellier,34000, France
[3] INRIA, Montpellier,34000, France
关键词
Deep learning; Pixel–object classification; Convolutional neural networks (CNNs); Multivariate time series; classification; 2D encoding representation; Land use/land cover;
D O I
10.1007/s00521-024-10186-2
中图分类号
学科分类号
摘要
With the advent of modern Earth observation (EO) systems, the opportunity of collecting satellite image time series (SITS) provides valuable insights to monitor spatiotemporal dynamics. Within this context, accurate land use/land cover (LULC) mapping plays a pivotal role in supporting territorial management and facilitating informed decision-making processes. However, traditional pixel-based and object-based classification methods often face challenges to effectively exploit spectral and spatial information. In this study, we propose Orthrus, a novel approach that fuses multi-scale information for enhanced LULC mapping. The proposed approach exploits several 2D encoding techniques to encode times series information into imagery. The resulting image is leveraged as input to a standard convolutional neural network (CNN) image classifier to cope with the downstream classification task. The evaluations on two real-world benchmarks, namely Dordogne and Reunion-Island, demonstrated the quality of Orthrus over state-of-the-art techniques from the field of land cover mapping based on SITS data. More precisely, Orthrus exhibits an enhancement of more than 3.5 accuracy points compared to the best competing approach on the Dordogne benchmark, and surpasses the best competing approach on the Reunion-Island dataset by over 3 accuracy points.
引用
收藏
页码:19247 / 19265
页数:18
相关论文
共 50 条
  • [21] A Convolutional Neural Network Approach to the Detection of LC Transitions in Multi-annual Satellite Image Time Series
    Meshkini, Khatereh
    Bovolo, Francesca
    Bruzzone, Lorenzo
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXIX, 2023, 12733
  • [22] Single infrared image stripe removal via deep multi-scale dense connection convolutional neural network
    Xu, Kai
    Zhao, Yaohong
    Li, Fangzhou
    Xiang, Wei
    INFRARED PHYSICS & TECHNOLOGY, 2022, 121
  • [23] Crop mapping from image time series: Deep learning with multi-scale label hierarchies
    Turkoglu, Mehmet Ozgur
    D'Aronco, Stefano
    Perich, Gregor
    Liebisch, Frank
    Streit, Constantin
    Schindler, Konrad
    Wegner, Jan Dirk
    REMOTE SENSING OF ENVIRONMENT, 2021, 264
  • [24] 2D medical image segmentation via learning multi-scale contextual dependencies
    Pang, Shuchao
    Du, Anan
    Yu, Zhenmei
    Orgun, Mehmet A.
    METHODS, 2022, 202 : 40 - 53
  • [25] Combining Sentinel-1 and Sentinel-2 Satellite Image Time Series for land cover mapping via a multi-source deep learning architecture
    Ienco, Dino
    Interdonato, Roberto
    Gaetano, Raffaele
    Dinh Ho Tong Minh
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 158 : 11 - 22
  • [26] Land Cover Maps Production with High Resolution Satellite Image Time Series and Convolutional Neural Networks: Adaptations and Limits for Operational Systems
    Stoian, Andrei
    Poulain, Vincent
    Inglada, Jordi
    Poughon, Victor
    Derksen, Dawa
    REMOTE SENSING, 2019, 11 (17)
  • [27] Feature refinement for image-based driver action recognition via multi-scale attention convolutional neural network
    Hu, Yaocong
    Lu, Mingqi
    Lu, Xiaobo
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 81 (81)
  • [28] MCPA: multi-scale cross perceptron attention network for 2D medical image segmentation
    Xu, Liang
    Chen, Mingxiao
    Cheng, Yi
    Song, Pengwu
    Shao, Pengfei
    Shen, Shuwei
    Yao, Peng
    Xu, Ronald X.
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (01)
  • [29] HYPERSPECTRAL IMAGE SUPER-RESOLUTION BASED ON MULTI-SCALE WAVELET 3D CONVOLUTIONAL NEURAL NETWORK
    Yang, Jingxiang
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 2770 - 2773
  • [30] MF-MSCNN: Multi-Feature based Multi-Scale Convolutional Neural Network for Image Dehazing Via Input Transformation
    Kumar, Balla Pavan
    Kumar, Arvind
    Pandey, Rajoo
    IETE JOURNAL OF RESEARCH, 2025,