A Pansharpening Based on Spatial-Spectral Modulation and Cooperation with Segmentation

被引:0
|
作者
Jiao J. [1 ,2 ]
Wu L. [1 ]
Wang P. [2 ]
机构
[1] Science and Technology on Complex Electronic System Simulation Laboratory, Space Engineering University, Beijing
[2] 32026 of PLA, Kaifeng
关键词
Cooperation between pansharpening and segmentation; Fusion of the multispectral and panchromatic images; K-means algorithm; Local adaptive spatial modulation; Local adaptive spectral modulation;
D O I
10.3724/SP.J.1089.2019.17907
中图分类号
学科分类号
摘要
In order to improve the fusion quality of the multispectral (MS) and panchromatic (PAN) images and achieve a balance between the injection of spatial details and the preservation of spectral information, a pansharpening method based on local adaptive spatial-spectral modulation and cooperation with segmentation is proposed in this paper. k-means algorithm is used to segment MS images into different connected component groups according to their spectral characteristics, then the local adaptive spectral modulation (LASpeM) and local adaptive spatial modulation (LASpaM) coefficients can be acquired based on local component groups. LASpeM coefficient matrix is estimated based on details extracted from MS and PAN images and also spectral relationship between MS bands; LASpaM coefficient matrix is constructed based on local deviation and correlation between the spectral characteristics of MS and low-resolution PAN images. Moreover, cooperation with segmentation is introduced to pansharpening in this paper, the LASpeM and LASpaM coefficients are estimated based on component groups to optimize the fusion image, and the feedback from fusion result is applied to adjust the parameters of the segmentation algorithm. The evaluation of the proposed method is performed in Matlab environment based on data sets from the GeoEye-1 and QuickBird satellites. Experimental results show that the proposed method achieves better visual results and objective evaluation indices than seven classic and state-of-the-art fusion methods, and prove that the method is able to balance the spatial and spectral information while reducing spectral distortion. © 2019, Beijing China Science Journal Publishing Co. Ltd. All right reserved.
引用
收藏
页码:2101 / 2112
页数:11
相关论文
共 38 条
  • [1] Han C., Zhang H.Y., Gao C.X., Et al., A remote sensing image fusion method based on the analysis sparse model, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9, 1, pp. 439-453, (2016)
  • [2] Xing Y.H., Wang M., Yang S.Y., Et al., Pan-sharpening via deep metric learning, ISPRS Journal of Photogrammetry and Remote Sensing, 145, pp. 165-183, (2018)
  • [3] Thomas C., Ranchin T., Wald L., Et al., Synthesis of multispectral images to high spatial resolution: a critical review of fusion methods based on remote sensing physics, IEEE Transactions on Geoscience and Remote Sensing, 46, 5, pp. 1301-1312, (2008)
  • [4] Aiazzi B., Alparone L., Baronti S., Et al., Twenty-five years of pansharpening: a critical review and new developments, Signal and Image Processing for Remote Sensing, pp. 533-548, (2012)
  • [5] Vivone G., Alparone L., Chanussot J., Et al., A critical comparison among pansharpening algorithms, IEEE Transactions on Geoscience and Remote Sensing, 53, 5, pp. 2565-2586, (2015)
  • [6] Joseph Carper W., Lillesand T.M., Kiefer R.W., The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data, Photogrammetric Engineering and Remote Sensing, 56, 4, pp. 459-467, (1990)
  • [7] Chavez P.S., Kwarteng A.Y., Extracting spectral contrast in Landsat thematic mapper image data using selective principal component analysis, Photogrammetric Engineering and Remote Sensing, 55, 3, pp. 339-348, (1989)
  • [8] Laben C.A., Brower B.V., Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening
  • [9] Garzelli A., Nencini F., Capobianco L., Optimal MMSE pan sharpening of very high resolution multispectral images, IEEE Transactions on Geoscience and Remote Sensing, 46, 1, pp. 228-236, (2008)
  • [10] Shensa M.J., The discrete wavelet transform: wedding the a trous and Mallat algorithms, IEEE Transactions on Signal Processing, 40, 10, pp. 2464-2482, (1992)