An Approach to Optimal Hyperspectral and Multispectral Signature and Image Fusion for Detecting Hidden Targets on Shorelines

Hyperspectral and multispectral imagery of shorelines collected from airborne and shipborne platforms are used following pushbroom imagery corrections using inertial motion motions units and augmented global positioning data and Kalman filtering. Corrected radiance or reflectance images are then used to optimize synthetic high spatial resolution spectral signatures resulting from an optimized data fusion process. The process demonstrated utilizes littoral zone features from imagery acquired in the Gulf of Mexico region. Shoreline imagery along the Banana River, Florida, is presented that utilizes a technique that makes use of numerically embedded targets in both higher spatial resolution multispectral images and lower spatial resolution hyperspectral imagery. The fusion process developed utilizes optimization procedures that include random selection of regions and pixels in the imagery, and minimizing the difference between the synthetic signatures and observed signatures. The optimized data fusion approach allows detection of spectral anomalies in the resolution enhanced data cubes. Spectral-spatial anomaly detection is demonstrated using numerically embedded line targets within actual imagery. The approach allows one to test spectral signature anomaly detection and to identify features and targets. The optimized data fusion techniques and software allows one to perform sensitivity analysis and optimization in the singular value decomposition model building process and the 2-D Butterworth cutoff frequency and order numerical selection process. The data fusion "synthetic imagery" forms a basis for spectral-spatial resolution enhancement for optimal band selection and remote sensing algorithm development within "spectral anomaly areas". Sensitivity analysis demonstrates the data fusion methodology is most sensitive to (a) the pixels and features used in the SVD model building process and (b) the 2-D Butterworth cutoff frequency optimized by application of K-S nonparametric test. The image fusion protocol is transferable to sensor data acquired from other platforms, including moving platforms as demonstrated.