Graph-Based Spatio-Temporal Semantic Reasoning Model for Anti-Occlusion Infrared Aerial Target Recognition

被引:1
|
作者
Yang, Xi [1 ]
Li, Shaoyi [1 ]
Niu, Saisai [2 ]
Yan, Binbin [1 ]
Meng, Zhongjie [1 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[2] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
基金
中国国家自然科学基金;
关键词
graph convolution network; infrared aerial targets; Anti-occlusion recognition; semantic reasoning model; vision-; inspired; OBJECT RECOGNITION;
D O I
10.1109/TMM.2024.3408051
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared target recognition and anti-interference in complex battlefields is one of the key technologies enabling the precise strike capability of aircraft. Currently, infrared-guided aircraft face complex interference such as natural backgrounds and artificial decoys, leading to a decrease in the performance of infrared target recognition. A particular challenge to infrared target recognition and anti-interference capabilities is the strong interference situation caused by the combination of target maneuvering and the dense, continuous, and coordinated deployment of infrared decoys. To address extreme issues such as complete loss of target feature information and inability to identify due to target occlusion, we develop an anti-interference recognition method based on a visually inspired Spatio-Temporal Semantic Reasoning Model (STSRM). Firstly, inspired by the functional characteristics of visual semantic reasoning, the STSRM is proposed to simplify the reasoning of relationships among multiple regions into modeling relationships between corresponding region node features in a graph-based module. Secondly, an anti-occlusion target recognition model based on STSRM is constructed, which introduces a reasoning graph module connecting node regions to infer semantic information and predict targets between regions. The test results on the infrared dataset established in this paper indicate that the proposed anti-interference recognition model can make accurate target predictions in large-scale or full-occlusion conditions, and we achieve 13.9% and 3.1% improvement on mAP scores and mIoU scores, compared to current advanced method on our simulated infrared dataset.
引用
收藏
页码:10530 / 10544
页数:15
相关论文
共 50 条
  • [21] Dynamic Spatio-Temporal Graph Reasoning for VideoQA With Self-Supervised Event Recognition
    Nie, Jie
    Wang, Xin
    Hou, Runze
    Li, Guohao
    Chen, Hong
    Zhu, Wenwu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4145 - 4158
  • [22] Worker Abnormal Behavior Recognition Based on Spatio-Temporal Graph Convolution and Attention Model
    Li, Zhiwei
    Zhang, Anyu
    Han, Fangfang
    Zhu, Junchao
    Wang, Yawen
    ELECTRONICS, 2023, 12 (13)
  • [23] Analyzing Shared Bike Usage Through Graph-Based Spatio-Temporal Modeling
    Cuong, Dinh Viet
    Ngo, Vuong M.
    Cappellari, Paolo
    Roantree, Mark
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 5 : 115 - 131
  • [24] Spatio-Temporal Heterogeneous Graph-Based Convolutional Networks for Traffic Flow Forecasting
    Ma, Zhaobin
    Lv, Zhiqiang
    Xin, Xiaoyang
    Cheng, Zesheng
    Xia, Fengqian
    Li, Jianbo
    TRANSPORTATION RESEARCH RECORD, 2024, 2678 (08) : 120 - 133
  • [25] Spatio-temporal graph-based self-labeling for video anomaly detection
    Xing, Meng
    Feng, Zhiyong
    Su, Yong
    Zhang, Yiming
    Oh, Changjae
    Gribova, Valeriya
    Filaretoy, Vladimir Fedorovich
    Huang, Deshuang
    NEUROCOMPUTING, 2025, 627
  • [26] Spatio-temporal interactive reasoning model for multi-group activity recognition
    Huang, Jianglan
    Li, Lindong
    Qing, Linbo
    Tang, Wang
    Wang, Pingyu
    Guo, Li
    Peng, Yonghong
    PATTERN RECOGNITION, 2025, 199
  • [27] Spatio-Temporal Graph Routing for Skeleton-Based Action Recognition
    Li, Bin
    Li, Xi
    Zhang, Zhongfei
    Wu, Fei
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8561 - 8568
  • [28] A Semantic Model for Computer-Based Spatio-Temporal Systems
    Hummel, Benjamin
    16TH ANNUAL IEEE INTERNATIONAL CONFERENCE AND WORKSHOP ON THE ENGINEERING OF COMPUTER BASED SYSTEMS, PROCEEDINGS, 2009, : 156 - 165
  • [29] Small Infrared Target Detection Based on Spatio-temporal Fusion Saliency
    Yao, Yao
    Hao, Yingguang
    Wang, Hongyu
    2017 17TH IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT 2017), 2017, : 1497 - 1502
  • [30] Multitarget Occlusion Tracking With 3-D Spatio-Temporal Context Graph Model
    Wan, Qin
    Lv, Ruifeng
    Xiao, Yueping
    Li, Zhi
    Zhu, Xiaolin
    Wang, Yaonan
    Liu, Haiqiao
    Zeng, Zilong
    IEEE SENSORS JOURNAL, 2023, 23 (18) : 21631 - 21639