Multilevel Fine-Grained Features-Based General Framework for Object Detection

被引:3
|
作者
Zuo, Fengyuan [1 ]
Liu, Jinhai [2 ,3 ]
Chen, Zhaolin [4 ]
Zhang, Huaguang [2 ,3 ]
Fu, Mingrui [5 ]
Wang, Lei [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110004, Peoples R China
[3] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
[4] Monash Univ, Monash Biomed Imaging, Clayton, Vic 3800, Australia
[5] Shenyang Paidelin Technol Co Ltd, Algorithm Grp Technol R&D Dept, Shenyang 110081, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Detectors; Object detection; Accuracy; Semantics; Location awareness; Multilevel fine-grained features; object detector; real-world applications; task specific prediction network (TSPN); NETWORK;
D O I
10.1109/TCYB.2024.3424430
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes a practical and generalizable object detector, termed feature extraction-fusion-prediction network (FEFP-Net) for real-world application scenarios. The existing object detection methods have recently achieved excellent performance, however they still face three major challenges for real-world applications, i.e., feature similarity between classes, object size variability, and inconsistent localization and classification predictions. In order to effectively alleviate the current difficulties, the FEFP-Net with three key components is proposed, and the improved detection accuracy is proved in various applications: 1) Extraction Phase: an adaptive fine-grained feature extraction network is proposed to capture features of interest from coarse to fine details, which effectively avoids misclassification due to feature similarity; 2) Fusion Phase: a bidirectional neighbor connection network is designed to identify objects with different sizes by aggregating multilevel features and 3) Prediction Phase: in order to improve the accuracy of object localization and classification, a task specific prediction network is presented, which sufficiently exploits both the spatial and channel information of features. Compared with the State-of-the-Art methods, we achieved competitive results in the MS-COCO dataset. Further, we demonstrated the performance of FEFP-Net in different application fields, such as medical imaging, industry, agriculture, transportation, and remote sensing. These comprehensive experiments indicate that FEFP-Net has satisfactory accuracy and generalizability as a basic object detector.
引用
收藏
页码:6921 / 6933
页数:13
相关论文
共 50 条
  • [41] Phase-based fine-grained change detection
    Wang, Xuzhi
    Wan, Liang
    Lin, Di
    Feng, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 227
  • [42] Fine-Grained Object Recognition with Gnostic Fields
    Kanan, Christopher
    2014 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2014, : 23 - 30
  • [43] An object-oriented framework for modeling watershed flow and sediment process based on fine-grained components
    Chuan cai Zhang
    Fen Qin
    Xi wang Zhang
    Jun Zhu
    Yong xin Zhang
    Hang Wang
    Arabian Journal of Geosciences, 2019, 12
  • [44] An object-oriented framework for modeling watershed flow and sediment process based on fine-grained components
    Zhang, Chuan cai
    Qin, Fen
    Zhang, Xi wang
    Zhu, Jun
    Zhang, Yong xin
    Wang, Hang
    ARABIAN JOURNAL OF GEOSCIENCES, 2019, 12 (19)
  • [45] FGFDect: A Fine-Grained Features Classification Model for Android Malware Detection
    Liu, Chao
    Li, Jianan
    Yu, Min
    Luo, Bo
    Li, Song
    Chen, Kai
    Huang, Weiqing
    Lv, Bin
    SECURITY AND PRIVACY IN COMMUNICATION NETWORKS, SECURECOMM 2018, PT I, 2018, 254 : 281 - 293
  • [46] Fine-grained identification of camera devices based on inherent features
    Wang, Ruimin
    Li, Ruixiang
    Dong, Weiyu
    Zhang, Zhiyong
    Jiang, Liehui
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (04) : 3767 - 3786
  • [47] Fine-Grained Activity Recognition with Holistic and Pose Based Features
    Pishchulin, Leonid
    Andriluka, Mykhaylo
    Schiele, Bernt
    PATTERN RECOGNITION, GCPR 2014, 2014, 8753 : 678 - 689
  • [48] Quality Control in Crowdsourcing based on Fine-Grained Behavioral Features
    Pei W.
    Yang Z.
    Chen M.
    Yue C.
    Proceedings of the ACM on Human-Computer Interaction, 2021, 5 (CSCW2)
  • [49] A Multiscale Deep Framework for Ocean Fronts Detection and Fine-Grained Location
    Sun, Xin
    Wang, Changgang
    Dong, Junyu
    Lima, Estanislau
    Yang, Yuting
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (02) : 178 - 182
  • [50] A fine-grained protection mechanism in object-based operating systems
    Shigeta, S
    Tanimori, T
    Shimizu, K
    Ashihara, H
    PROCEEDINGS OF THE FIFTH INTERNATIONAL WORKSHOP ON OBJECT-ORIENTATION IN OPERATING SYSTEMS, 1996, : 156 - 160