Fusion of remote sensing images based on nonsubsampled contourlet transform and region segmentation

The purpose of remote sensing images fusion is to produce a fused image that contains more clear, accurate and comprehensive information than any single image. A novel fusion method is proposed in this paper based on nonsubsampled contourlet transform (NSCT) and region segmentation. Firstly, the multispectral image is transformed to intensity-hue-saturation (IHS) system. Secondly, the panchromatic image and the component intensity of the multispectral image are decomposed by NSCT. Then the NSCT coefficients of high and low frequency subbands are fused by different rules, respectively. For the high frequency subbands, the fusion rules are also unalike in the smooth and edge regions. The two regions are segregated in the panchromatic image, and the segmentation is based on particle swarm optimization. Finally, the fusion image can be obtained by performing inverse NSCT and inverse IHS transform. The experimental results are evaluated by both subjective and objective criteria. It is shown that the proposed method can obtain superior results to others. © 2011 Shanghai Jiaotong University and Springer-Verlag Berlin Heidelberg.