Graph-Based Spatio-Temporal Semantic Reasoning Model for Anti-Occlusion Infrared Aerial Target Recognition

被引:1
|
作者
Yang, Xi [1 ]
Li, Shaoyi [1 ]
Niu, Saisai [2 ]
Yan, Binbin [1 ]
Meng, Zhongjie [1 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[2] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
基金
中国国家自然科学基金;
关键词
graph convolution network; infrared aerial targets; Anti-occlusion recognition; semantic reasoning model; vision-; inspired; OBJECT RECOGNITION;
D O I
10.1109/TMM.2024.3408051
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared target recognition and anti-interference in complex battlefields is one of the key technologies enabling the precise strike capability of aircraft. Currently, infrared-guided aircraft face complex interference such as natural backgrounds and artificial decoys, leading to a decrease in the performance of infrared target recognition. A particular challenge to infrared target recognition and anti-interference capabilities is the strong interference situation caused by the combination of target maneuvering and the dense, continuous, and coordinated deployment of infrared decoys. To address extreme issues such as complete loss of target feature information and inability to identify due to target occlusion, we develop an anti-interference recognition method based on a visually inspired Spatio-Temporal Semantic Reasoning Model (STSRM). Firstly, inspired by the functional characteristics of visual semantic reasoning, the STSRM is proposed to simplify the reasoning of relationships among multiple regions into modeling relationships between corresponding region node features in a graph-based module. Secondly, an anti-occlusion target recognition model based on STSRM is constructed, which introduces a reasoning graph module connecting node regions to infer semantic information and predict targets between regions. The test results on the infrared dataset established in this paper indicate that the proposed anti-interference recognition model can make accurate target predictions in large-scale or full-occlusion conditions, and we achieve 13.9% and 3.1% improvement on mAP scores and mIoU scores, compared to current advanced method on our simulated infrared dataset.
引用
收藏
页码:10530 / 10544
页数:15
相关论文
共 50 条
  • [1] Anti-Occlusion Infrared Aerial Target Recognition With Multisemantic Graph Skeleton Model
    Yang, Xi
    Li, Shaoyi
    Sun, Shijie
    Yan, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Anti-occlusion real time target tracking algorithm employing spatio-temporal context
    Chen, Faling
    Ding, Qinghai
    Luo, Haibo
    Hui, Bin
    Chang, Zheng
    Liu, Yunpeng
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2021, 50 (01):
  • [3] Spatio-temporal Self-learning Object Tracking Model Based on Anti-occlusion Mechanism
    Hu, Qiang
    Wu, Hongrun
    Wu, Jiahao
    Shen, Jinrong
    Hu, Haorong
    Chen, Yingpin
    Wang, Lingzhi
    Zhang, Hualin
    Engineering Letters, 2023, 31 (03) : 1141 - 1150
  • [4] Spatio-Temporal Graph-based Semantic Compositional Network for Video Captioning
    Li, Shun
    Zhang, Ze-Fan
    Ji, Yi
    Li, Ying
    Liu, Chun-Ping
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [5] Graph-based spatio-temporal region extraction
    Galmar, Eric
    Huet, Benoit
    IMAGE ANALYSIS AND RECOGNITION, PT 1, 2006, 4141 : 236 - 247
  • [6] Graph-based approach for human action recognition using spatio-temporal features
    Ben Aoun, Najib
    Mejdoub, Mahmoud
    Ben Amar, Chokri
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (02) : 329 - 338
  • [7] EEG Emotion Recognition via Graph-based Spatio-Temporal Attention Neural Networks
    Sartipi, Shadi
    Torkamani-Azar, Mastaneh
    Cetin, Mujdat
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 571 - 574
  • [8] Anti-interference recognition method of aerial infrared targets based on a spatio-temporal correlation inference network
    Zhang, Liang
    Tian, Xiaoqian
    Li, Shaoyi
    Yang, Xi
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (07):
  • [9] AO-AutoTrack: Anti-occlusion Real-Time UAV Tracking Based on Spatio-temporal Context
    Chu, Hongyu
    Liao, Kuisheng
    Shao, Yanhua
    Zhang, Xiaoqiang
    Mei, Yanying
    Wu, Yadong
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, 2021, 13019 : 256 - 267
  • [10] Small Target Detection in Infrared Videos Based on Spatio-Temporal Tensor Model
    Liu, Hong-Kang
    Zhang, Lei
    Huang, Hua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (12): : 8689 - 8700