Multilevel Fine-Grained Features-Based General Framework for Object Detection

被引:3
|
作者
Zuo, Fengyuan [1 ]
Liu, Jinhai [2 ,3 ]
Chen, Zhaolin [4 ]
Zhang, Huaguang [2 ,3 ]
Fu, Mingrui [5 ]
Wang, Lei [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110004, Peoples R China
[3] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
[4] Monash Univ, Monash Biomed Imaging, Clayton, Vic 3800, Australia
[5] Shenyang Paidelin Technol Co Ltd, Algorithm Grp Technol R&D Dept, Shenyang 110081, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Detectors; Object detection; Accuracy; Semantics; Location awareness; Multilevel fine-grained features; object detector; real-world applications; task specific prediction network (TSPN); NETWORK;
D O I
10.1109/TCYB.2024.3424430
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes a practical and generalizable object detector, termed feature extraction-fusion-prediction network (FEFP-Net) for real-world application scenarios. The existing object detection methods have recently achieved excellent performance, however they still face three major challenges for real-world applications, i.e., feature similarity between classes, object size variability, and inconsistent localization and classification predictions. In order to effectively alleviate the current difficulties, the FEFP-Net with three key components is proposed, and the improved detection accuracy is proved in various applications: 1) Extraction Phase: an adaptive fine-grained feature extraction network is proposed to capture features of interest from coarse to fine details, which effectively avoids misclassification due to feature similarity; 2) Fusion Phase: a bidirectional neighbor connection network is designed to identify objects with different sizes by aggregating multilevel features and 3) Prediction Phase: in order to improve the accuracy of object localization and classification, a task specific prediction network is presented, which sufficiently exploits both the spatial and channel information of features. Compared with the State-of-the-Art methods, we achieved competitive results in the MS-COCO dataset. Further, we demonstrated the performance of FEFP-Net in different application fields, such as medical imaging, industry, agriculture, transportation, and remote sensing. These comprehensive experiments indicate that FEFP-Net has satisfactory accuracy and generalizability as a basic object detector.
引用
收藏
页码:6921 / 6933
页数:13
相关论文
共 50 条
  • [1] Multilevel Fine-Grained Features-Based General Framework for Object Detection
    Zuo, Fengyuan
    Liu, Jinhai
    Chen, Zhaolin
    Zhang, Huaguang
    Fu, Mingrui
    Wang, Lei
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (11) : 6921 - 6933
  • [2] A General Vocabulary Based Approach for Fine-Grained Object Recognition
    Aich, Shubhra
    Lee, Chil-Woo
    IMAGE AND VIDEO TECHNOLOGY, PSIVT 2015, 2016, 9431 : 572 - 581
  • [3] A deceptive review detection framework: Combination of coarse and fine-grained features
    Cao, Ning
    Ji, Shujuan
    Chiu, Dickson K. W.
    He, Mingxiang
    Sun, Xiaohong
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 156
  • [4] Towards Fine-Grained Recognition: Joint Learning for Object Detection and Fine-Grained Classification
    Wang, Qiaosong
    Rasmussen, Christopher
    ADVANCES IN VISUAL COMPUTING, ISVC 2019, PT II, 2019, 11845 : 332 - 344
  • [5] Multilevel depression status detection based on fine-grained prompt learning
    Zhang, Jun
    Guo, Yanrong
    PATTERN RECOGNITION LETTERS, 2024, 178 : 167 - 173
  • [6] FT-Loc: A Fine-Grained Temporal Features-Based Fusion Network for Indoor Localization
    Liu, Minmin
    Liao, Xuewen
    Gao, Zhenzhen
    Li, Qiao
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (03) : 4324 - 4334
  • [7] Fine-Grained Object Detection Based on Self-Adaptive Anchors
    Ma, Kaili
    Zhang, Jun
    Wang, Fenglei
    Tu, Dan
    Li, Shuohao
    2017 2ND INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC 2017), 2017, : 78 - 82
  • [8] Aggregating Object Features Based on Attention Weights for Fine-Grained Image Retrieval
    Lin, HongLi
    Song, Yongqi
    Zeng, Zixuan
    Wang, Weisheng
    Wang, Jiayi
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2838 - 2844
  • [9] Efficient object detection and segmentation for fine-grained recognition
    Angelova, Anelia
    Zhu, Shenghuo
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 811 - 818
  • [10] A Blockchain-based Framework for News Fine-grained Detection and Management
    Han, Huijian
    Chen, Peidong
    Yang, Feng
    Zhang, Rui
    2022 5TH INTERNATIONAL CONFERENCE ON BLOCKCHAIN TECHNOLOGY AND APPLICATIONS, ICBTA 2022, 2022, : 95 - 103