Multi-sensor integration and image recognition using fuzzy adaptive resonance theory

The main objective of this work was to investigate the use of ''Sensor Based Real Time Decision and Control Technology'' applied to actively central the arrestment of aircraft (Manned or Unmanned), The proposed method is to develop an adaptively controlled system that would locate the aircraft's extended tailhook, predict its position and speed at the time of arrestment, adjust an arresting end effector to actively mate with the arresting hook and remove the aircraft's kinetic energy, thus minimizing the arresting distance and impact stresses. The focus of the work presented in this paper was to explore the use of Fuzzy Adaptive Resonance Theorem (FuzzyArt) Neural Network to form a MSI scheme which reduces image data to recognize incoming aircraft and extended tailhook. Using inputs from several Image sources a single fused image was generated to give details about range and tailhook characteristics for an F18 naval aircraft. The idea is to partition an image into cells and evaluate each using FuzzyArt. Once the incoming aircraft is located in a cell that subimage is again divided into smaller cells. This image is evaluated to locate various parts of the aircraft (i.e., wings, tail, tailhook, etc..). The cell that contains the tailhook provides resolved position information. Multiple images from separate sensors provides opportunity to generate range details overtime.