IPD-Net: Infrared Pedestrian Detection Network via Adaptive Feature Extraction and Coordinate Information Fusion

被引:7
|
作者
Zhou, Lun [1 ,2 ]
Gao, Song [1 ,2 ]
Wang, Simin [1 ,2 ]
Zhang, Hengsheng [1 ,2 ]
Liu, Ruochen [1 ,2 ]
Liu, Jiaming [1 ,2 ]
机构
[1] Chengdu Univ Technol, Minist Educ, Key Lab Earth Explorat & Informat Tech, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Coll Mech & Elect Engn, Chengdu 610059, Peoples R China
基金
中国国家自然科学基金;
关键词
infrared images; infrared target detection; pedestrian detection; attention mechanism; YOLOv5; VIDEO SURVEILLANCE; ROBUST;
D O I
10.3390/s22228966
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Infrared pedestrian detection has important theoretical research value and a wide range of application scenarios. Because of its special imaging method, infrared images can be used for pedestrian detection at night and in severe weather conditions. However, the lack of pedestrian feature information in infrared images and the small scale of pedestrian objects makes it difficult for detection networks to extract feature information and accurately detect small-scale pedestrians. To address these issues, this paper proposes an infrared pedestrian detection network based on YOLOv5, named IPD-Net. Firstly, an adaptive feature extraction module (AFEM) is designed in the backbone network section, in which a residual structure with stepwise selective kernel was included to enable the model to better extract feature information under different sizes of the receptive field. Secondly, a coordinate attention feature pyramid network (CA-FPN) is designed to enhance the deep feature map with location information through the coordinate attention module, so that the network gains better capability of object localization. Finally, shallow information is introduced into the feature fusion network to improve the detection accuracy of weak and small objects. Experimental results on the large infrared image dataset ZUT show that the mean Average Precision (mAP50) of our model is improved by 3.6% compared to that of YOLOv5s. In addition, IPD-Net shows various degrees of accuracy improvement compared to other excellent methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Few Shot Object Detection via a Generalized Feature Extraction Net
    Zhang, Dengyong
    Pu, Huaijian
    Li, Feng
    Sherratt, Simon
    Lim, Se -Jung
    JOURNAL OF INTERNET TECHNOLOGY, 2023, 24 (02): : 305 - 312
  • [42] FRCFNet: Feature Reassembly and Context Information Fusion Network for Road Extraction
    Wang, Haijuan
    Bai, Lin
    Xue, Danni
    Momi, Moslema Chowdhuray
    Ye, Zhen
    Quan, Siwen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [43] Region of interest identification, feature extraction, and information fusion in a forward looking infrared sensor used in landmine detection
    Nelson, BN
    IEEE WORKSHOP ON COMPUTER VISION BEYOND THE VISIBLE SPECTRUM: METHODS AND APPLICATIONS, PROCEEDINGS, 2000, : 94 - 103
  • [44] A feature pyramid network with adaptive fusion strategy and enhanced semantic information
    Qin, Longfei
    Pang, Wenchao
    Zhao, Dexin
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [45] EDASNet: efficient dynamic adaptive-scale network for infrared pedestrian detection
    Liu, Yang
    Zhang, Ming
    Fan, Fei
    Yu, Dahua
    Li, Jianjun
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (11)
  • [46] Joint information fusion and multi-scale network model for pedestrian detection
    Zhang, Hexiang
    Hu, Ziyu
    Hao, Ruoxin
    VISUAL COMPUTER, 2021, 37 (08): : 2433 - 2442
  • [47] OBJECT DETECTION VIA FEATURE FUSION BASED SINGLE NETWORK
    Li, Jian
    Qian, Jianjun
    Yang, Jian
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3390 - 3394
  • [48] Joint information fusion and multi-scale network model for pedestrian detection
    Hexiang Zhang
    Ziyu Hu
    Ruoxin Hao
    The Visual Computer, 2021, 37 : 2433 - 2442
  • [49] The Fusion of Infrared and Visible Images via Feature Extraction and Subwindow Variance Filtering
    Feng, Xin
    Gong, Haifeng
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2024, 2024
  • [50] Detection of Infrared Small Targets Using Feature Fusion Convolutional Network
    Wang, Kaidi
    Li, Shaoyi
    Niu, Saisai
    Zhang, Kai
    IEEE ACCESS, 2019, 7 : 146081 - 146092