Multi-Source and Multi-Temporal Image Fusion on Hypercomplex Bases

被引:11
|
作者
Schmitt, Andreas [1 ]
Wendleder, Anna [2 ]
Kleynmans, Ruediger [1 ]
Hell, Maximilian [1 ]
Roth, Achim [2 ]
Hinz, Stefan [3 ]
机构
[1] Munich Univ Appl Sci, Geoinformat Dept, Karlstr 6, D-80333 Munich, Germany
[2] German Aerosp Ctr DLR, EOC, D-82234 Wessling, Germany
[3] KIT, Inst Photogrammetry & Remote Sensing IPF, Englerstr 7, D-76131 Karlsruhe, Germany
关键词
Kennaugh framework; quaternion; hypercomplex bases; image fusion; time series; change detection; SAR sharpening; data cube; analysis ready data; efficient archiving; CLASSIFICATION ACCURACY; SAR; MULTISCALE; MULTIFREQUENCY;
D O I
10.3390/rs12060943
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This article spanned a new, consistent framework for production, archiving, and provision of analysis ready data (ARD) from multi-source and multi-temporal satellite acquisitions and an subsequent image fusion. The core of the image fusion was an orthogonal transform of the reflectance channels from optical sensors on hypercomplex bases delivered in Kennaugh-like elements, which are well-known from polarimetric radar. In this way, SAR and Optics could be fused to one image data set sharing the characteristics of both: the sharpness of Optics and the texture of SAR. The special properties of Kennaugh elements regarding their scaling-linear, logarithmic, normalized-applied likewise to the new elements and guaranteed their robustness towards noise, radiometric sub-sampling, and therewith data compression. This study combined Sentinel-1 and Sentinel-2 on an Octonion basis as well as Sentinel-2 and ALOS-PALSAR-2 on a Sedenion basis. The validation using signatures of typical land cover classes showed that the efficient archiving in 4 bit images still guaranteed an accuracy over 90% in the class assignment. Due to the stability of the resulting class signatures, the fuzziness to be caught by Machine Learning Algorithms was minimized at the same time. Thus, this methodology was predestined to act as new standard for ARD remote sensing data with an subsequent image fusion processed in so-called data cubes.
引用
收藏
页数:37
相关论文
共 50 条
  • [1] Multi-temporal and multi-source remote sensing image classification by nonlinear relative normalization
    Tuia, Devis
    Marcos, Diego
    Camps-Valls, Gustau
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2016, 120 : 1 - 12
  • [2] Multi-temporal and Multi-source Alpine Glacier Cover Classification
    Callegari, Mattia
    Marin, Carlo
    Notarnicola, Claudia
    [J]. 2017 9TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2017,
  • [3] CLOUD REMOVAL BY FUSING MULTI-SOURCE AND MULTI-TEMPORAL IMAGES
    Zhang, Chengyue
    Li, Zhiwei
    Cheng, Qing
    Li, Xinghua
    Shen, Huanfeng
    [J]. 2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 2577 - 2580
  • [4] A survey of multi-source image fusion
    Li, Rui
    Zhou, Mingquan
    Zhang, Dan
    Yan, Yuhuan
    Huo, Qingsong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 18573 - 18605
  • [5] A survey of multi-source image fusion
    Rui Li
    Mingquan Zhou
    Dan Zhang
    Yuhuan Yan
    Qingsong Huo
    [J]. Multimedia Tools and Applications, 2024, 83 : 18573 - 18605
  • [6] Reducing error in small-area estimates of multi-source forest inventory by multi-temporal data fusion
    Katila, Matti
    Heikkinen, Juha
    [J]. FORESTRY, 2020, 93 (03): : 471 - 480
  • [7] The Integration of The Multi-Source Data for Multi-Temporal Investigation of Cultural Heritage Objects
    Markiewicz, Jakub
    Bochenska, Agnieszka
    Kot, Patryk
    Lapinski, Slawomir
    Muradov, Magomed
    [J]. 2021 14TH INTERNATIONAL CONFERENCE ON DEVELOPMENTS IN ESYSTEMS ENGINEERING (DESE), 2021, : 63 - 68
  • [8] MsIFT: Multi-Source Image Fusion Transformer
    Zhang, Xin
    Jiang, Hangzhi
    Xu, Nuo
    Ni, Lei
    Huo, Chunlei
    Pan, Chunhong
    [J]. REMOTE SENSING, 2022, 14 (16)
  • [9] Variational approach for multi-source image fusion
    Tang, Sizhang
    Fang, Faming
    Zhang, Guixu
    [J]. IET IMAGE PROCESSING, 2015, 9 (02) : 134 - 141
  • [10] MULTI-TEMPORAL MAPS AS A SOURCE FOR STUDYING THE IMAGE OF YAKUTIA
    Sawinova A
    Filippova, V
    Gadal S
    [J]. SGEM 2016, BK 3: ANTHROPOLOGY, ARCHAEOLOGY, HISTORY & PHILOSOPHY CONFERENCE PROCEEDINGS, VOL II, 2016, : 449 - 456