A Method of Aerial Multi-Modal Image Registration for a Low-Visibility Approach Based on Virtual Reality Fusion

被引:3
|
作者
Wu, Yuezhou [1 ]
Liu, Changjiang [2 ]
机构
[1] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618307, Peoples R China
[2] Sichuan Univ Sci & Engn, Key Lab Higher Educ Sichuan Prov Enterprise Inform, Zigong 643000, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 06期
基金
国家重点研发计划;
关键词
infrared image; multi-modal images; image registration; image fusion; EVS (enhanced vision system);
D O I
10.3390/app13063396
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Aiming at the approach and landing of an aircraft under low visibility, this paper studies the use of an infrared heat-transfer imaging camera and visible-light camera to obtain dynamic hyperspectral images of flight approach scenes from the perspective of enhancing pilot vision. Aiming at the problems of affine deformation, difficulty in extracting similar geometric features, thermal shadows, light shadows, and other issues in heterogenous infrared and visible-light image registration, a multi-modal image registration method based on RoI driving in a virtual scene, RoI feature extraction, and virtual-reality-fusion-based contour angle orientation is proposed, and this could reduce the area to be registered, reduces the amount of computation, and improves the real-time registration accuracy. Aiming at the differences in multi-modal image fusion in terms of resolution, contrast, color channel, color information strength, and other aspects, the contour angle orientation maintains the geometric deformation of multi-source images well, and the virtual reality fusion technology effectively deletes incorrectly matched point pairs. By integrating redundant information and complementary information from multi-modal images, the visual perception abilities of pilots during the approach process are enhanced as a whole.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Colour image cross-modal retrieval method based on multi-modal visual data fusion
    Liu, Xiangyuan
    International Journal of Computational Intelligence Studies, 2023, 12 (1-2) : 118 - 129
  • [22] Adherent Peanut Image Segmentation Based on Multi-Modal Fusion
    Wang, Yujing
    Ye, Fang
    Zeng, Jiusun
    Cai, Jinhui
    Huang, Wangsen
    SENSORS, 2024, 24 (14)
  • [23] Fabric image retrieval based on multi-modal feature fusion
    Ning Zhang
    Yixin Liu
    Zhongjian Li
    Jun Xiang
    Ruru Pan
    Signal, Image and Video Processing, 2024, 18 : 2207 - 2217
  • [24] Multi-modal Image Fusion Based on ROI and Laplacian Pyramid
    Gao, Xiong
    Zhang, Hong
    Chen, Hao
    Li, Jiafeng
    SIXTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2014), 2015, 9443
  • [25] Fabric image retrieval based on multi-modal feature fusion
    Zhang, Ning
    Liu, Yixin
    Li, Zhongjian
    Xiang, Jun
    Pan, Ruru
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2207 - 2217
  • [26] VIRTUAL REALITY BASED MULTI-MODAL TELEOPERATION USING MIXED AUTONOMY
    Kadavasal, Muthukkumar S.
    Seth, Abhishek
    Oliver, James H.
    DETC 2008: PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATIONAL IN ENGINEERING CONFERENCE, VOL 3, PTS A AND B: 28TH COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2009, : 1451 - 1460
  • [27] A MULTI-MODAL AUTOMATIC IMAGE REGISTRATION TECHNIQUE BASED ON COMPLEX WAVELETS
    Ghantous, Milad
    Ghosh, Somik
    Bayoumi, Magdy
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 173 - 176
  • [28] Multi-Modal Image Registration Based on Gradient Orientations of Minimal Uncertainty
    De Nigris, Dante
    Collins, D. Louis
    Arbel, Tal
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2012, 31 (12) : 2343 - 2354
  • [29] Image registration in stereo-based multi-modal imaging systems
    Hild, M
    Umeda, G
    ISPA 2005: PROCEEDINGS OF THE 4TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2005, : 70 - 75
  • [30] Structural Representations for Multi-modal Image Registration Based on Modified Entropy
    Kasiri, Keyvan
    Fieguth, Paul
    Clausi, David A.
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2015), 2015, 9164 : 82 - 89