Multi-Spectral Ship Target Recognition Based on Feature Level Fusion

Aiming at solving the problem of inadequate ability of recognizing single band warship targets on the sea in complicated situations, image fusion technology for three band feature levels of visible light, short wave infrared and medium wave infrared has been studied. Problems of time-consuming and fusion strategy existed in image fusion have been solved as top priorities. A new multi-band fusion method based on regional covariance matrix has been proposed in this paper. The advantage is that it can fuse several related features naturally through low dimensional vector. This paper has designed 11-dimensional and 5-dimensional feature vectors for visible light image and infrared image respectively, which not only ensures the differences among different targets but also decreases the calculation. Saliency detection has been adopted firstly in this paper to position the target area in the image quickly; and then, distance calculation formula of covariance matrix has been defined for the feature vectors of different band image designs and matching has been made in the following; integral image has been attained through one traversal operation for the image; purpose of quick calculation has been realized in the calculation for covariance; finally, K-nearest neighbor (KNN) algorithm has been adopted to make classification and recognition for various warship targets. Over 3 400 images of three-band warship target have been used as testing data. The experiment mainly includes two parts: first, comparing the recognition rate of single-band and three-band fusion recognition and to verify that the fusion method proposed in this paper has more extensive application range. Second, comparing several traditional pixel level methods in the calculation efficiency to verify the advantages of feature fusion adopted in this paper in calculation time. Experimental results have shown that the recognition rate of this method can reach 95. 1% and time for single frame calculation is about 0. 5 s, which has made distinctive improvement in both real time and detection rate.