Multilevel Fine-Grained Features-Based General Framework for Object Detection

被引:3
|
作者
Zuo, Fengyuan [1 ]
Liu, Jinhai [2 ,3 ]
Chen, Zhaolin [4 ]
Zhang, Huaguang [2 ,3 ]
Fu, Mingrui [5 ]
Wang, Lei [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110004, Peoples R China
[3] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
[4] Monash Univ, Monash Biomed Imaging, Clayton, Vic 3800, Australia
[5] Shenyang Paidelin Technol Co Ltd, Algorithm Grp Technol R&D Dept, Shenyang 110081, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Detectors; Object detection; Accuracy; Semantics; Location awareness; Multilevel fine-grained features; object detector; real-world applications; task specific prediction network (TSPN); NETWORK;
D O I
10.1109/TCYB.2024.3424430
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes a practical and generalizable object detector, termed feature extraction-fusion-prediction network (FEFP-Net) for real-world application scenarios. The existing object detection methods have recently achieved excellent performance, however they still face three major challenges for real-world applications, i.e., feature similarity between classes, object size variability, and inconsistent localization and classification predictions. In order to effectively alleviate the current difficulties, the FEFP-Net with three key components is proposed, and the improved detection accuracy is proved in various applications: 1) Extraction Phase: an adaptive fine-grained feature extraction network is proposed to capture features of interest from coarse to fine details, which effectively avoids misclassification due to feature similarity; 2) Fusion Phase: a bidirectional neighbor connection network is designed to identify objects with different sizes by aggregating multilevel features and 3) Prediction Phase: in order to improve the accuracy of object localization and classification, a task specific prediction network is presented, which sufficiently exploits both the spatial and channel information of features. Compared with the State-of-the-Art methods, we achieved competitive results in the MS-COCO dataset. Further, we demonstrated the performance of FEFP-Net in different application fields, such as medical imaging, industry, agriculture, transportation, and remote sensing. These comprehensive experiments indicate that FEFP-Net has satisfactory accuracy and generalizability as a basic object detector.
引用
收藏
页码:6921 / 6933
页数:13
相关论文
共 50 条
  • [31] Fine-grained label learning in object detection with weak supervision of captions
    Xue Wang
    Youtian Du
    Suzan Verberne
    Fons J. Verbeek
    Multimedia Tools and Applications, 2023, 82 : 6557 - 6579
  • [32] FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detection
    Ma, Shuailei
    Wang, Yuefeng
    Wang, Shanze
    Wei, Ying
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (04) : 2415 - 2429
  • [33] Con-Text: Text Detection for Fine-Grained Object Classification
    Karaoglu, Sezer
    Tao, Ran
    van Gemert, Jan C.
    Gevers, Theo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (08) : 3965 - 3980
  • [34] Fine-Grained Object Detection Using Transfer Learning and Data Augmentation
    Dalal, Rahul
    Moh, Teng-Sheng
    2018 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM), 2018, : 893 - 896
  • [35] Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images
    Zhou, Yong
    Wang, Sifan
    Zhao, Jiaqi
    Zhu, Hancheng
    Yao, Rui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [36] Keypoint Density-based Region Proposal for Fine-Grained Object Detection using Regions with Convolutional Neural Network Features
    Turner, J. T.
    Gupta, Kalyan Moy
    Aha, David
    2016 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2016,
  • [37] FeatInter: Exploring fine-grained object features for video-text retrieval
    Liu, Baolong
    Zheng, Qi
    Wang, Yabing
    Zhang, Minsong
    Dong, Jianfeng
    Wang, Xun
    NEUROCOMPUTING, 2022, 496 : 178 - 191
  • [38] Fine-Grained Features for Image Captioning
    Shao, Mengyue
    Feng, Jie
    Wu, Jie
    Zhang, Haixiang
    Zheng, Yayu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 4697 - 4712
  • [39] A GENERAL, FINE-GRAINED, MACHINE-INDEPENDENT, OBJECT-ORIENTED LANGUAGE
    ANDERSEN, B
    SIGPLAN NOTICES, 1994, 29 (05): : 17 - 26
  • [40] Rotation-lossless Non-local Attention and Fine-grained Feature Enhancement based Fine-grained Oriented Object Detection in Remote Sensing Images
    Guo, Weilong
    Li, Xuan
    Li, Shengyang
    2023 5TH INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS, ICCR, 2023, : 277 - 286