Deep convolution neural network with scene-centric and object-centric information for object detection

被引:14
|
作者
Shen, Zong-Ying [1 ]
Han, Shiang-Yu [1 ]
Fu, Li-Chen [1 ]
Hsiao, Pei-Yung [2 ]
Lau, Yo-Chung [3 ]
Chang, Sheng-Jen [3 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei, Taiwan
[2] Natl Univ Kaohsiung, Dept Elect Engn, Kaohsiung, Taiwan
[3] Chunghwa Telecom Co Ltd, Telecommun Labs, Taipei, Taiwan
关键词
Deep learning; Convolutional neural networks; Real-time object detection; Scene information;
D O I
10.1016/j.imavis.2019.03.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, Deep Convolutional Neural Network (CNN) has shown an impressive performance on computer vision field. The ability of learning feature representations from large training dataset makes deep CNN outperform traditional hand-crafted features approaches on object classification and detection. However, computations for deep CNN models are time consuming due to their high complexity, which makes it hardly applicable to real world application, such as Advance Driver Assistance System (ADAS). To reduce the computation complexity, several fast object detection frameworks in the literature have been proposed, such as SSD and YOLO. Although these kinds of method can run at real-time, they usually struggle with dealing of small objects due to the difficulty of handling smaller input image size. Based on our observation, we propose a novel object detection framework which combines the feature representations learned from object-centric and scene-centric datasets with an aim to improve the accuracy on detecting especially small objects. The experimental results on MSCOCO dataset show that our method can actually improve the detection accuracy of small objects, which leads to better overall results. We also evaluate our method on PASCAL VOC 2012 datasets, and the results show that our method not only can achieve state-of-the-art accuracy but also most importantly presents in real-time. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:14 / 25
页数:12
相关论文
共 50 条
  • [1] Deep Object-Centric Pooling in Convolutional Neural Network for Remote Sensing Scene Classification
    Qi, Kunlun
    Yang, Chao
    Hu, Chuli
    Shen, Yonglin
    Wu, Huayi
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 7857 - 7868
  • [2] Deep Object-Centric Pooling in Convolutional Neural Network for Remote Sensing Scene Classification
    Qi, Kunlun
    Yang, Chao
    Hu, Chuli
    Shen, Yonglin
    Wu, Huayi
    [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14 : 7857 - 7868
  • [3] Exploring Object-Centric and Scene-Centric CNN Features and Their Complementarity for Human Rights Violations Recognition in Images
    Kalliatakis, Grigorios
    Ehsan, Shoaib
    Leonardis, Ales
    Fasli, Maria
    Mcdonald-Maier, Klaus D.
    [J]. IEEE ACCESS, 2019, 7 : 10045 - 10056
  • [4] OSIN: Object-Centric Scene Inference Network for Unsupervised Video Anomaly Detection
    Liu, Yang
    Guo, Zhengliang
    Liu, Jing
    Li, Chengfang
    Song, Liang
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 359 - 363
  • [5] Scene-Centric vs. Object-Centric Image-Text Cross-Modal Retrieval: A Reproducibility Study
    Hendriksen, Mariya
    Vakulenko, Svitlana
    Kuiper, Ernst
    de Rijke, Maarten
    [J]. ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT III, 2023, 13982 : 68 - 85
  • [6] Object-Centric Debugging
    Ressia, Jorge
    Bergel, Alexandre
    Nierstrasz, Oscar
    [J]. 2012 34TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2012, : 485 - 495
  • [7] Object-Centric Multiple Object Tracking
    Zhao, Zixu
    Wang, Jiaze
    Horn, Max
    Ding, Yizhuo
    He, Tong
    Bai, Zechen
    Zietlow, Dominik
    Simon-Gabriel, Carl-Johann
    Shuai, Bing
    Tu, Zhuowen
    Brox, Thomas
    Schiele, Bernt
    Fu, Yanwei
    Locatello, Francesco
    Zhang, Zheng
    Xiao, Tianjun
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 16555 - 16565
  • [8] Compositional scene modeling with global object-centric representations
    Tonglin Chen
    Zhimeng Shen
    Bin Li
    Xiangyang Xue
    [J]. Machine Learning, 2024, 113 : 3505 - 3524
  • [9] Object-Centric Scene Representations Using Active Inference
    Van de Maele, Toon
    Verbelen, Tim
    Mazzaglia, Pietro
    Ferraro, Stefano
    Dhoedt, Bart
    [J]. NEURAL COMPUTATION, 2024, 36 (04) : 677 - 704
  • [10] Deep Object-Centric Policies for Autonomous Driving
    Wang, Dequan
    Devin, Coline
    Cai, Qi-Zhi
    Yu, Fisher
    Darrell, Trevor
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 8853 - 8859