A Configurable Heterogeneous Multicore Architecture with Cellular Neural Network for Real-Time Object Recognition

被引:11
|
作者
Kim, Kwanho [1 ]
Lee, Seungjin [1 ]
Kim, Joo-Young [1 ]
Kim, Minsu [1 ]
Yoo, Hoi-Jun [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Elect Engn & Comp Sci, Div Elect Engn, Daemon 305701, South Korea
关键词
Cellular neural network; multicore; object recognition; parallelism; SIMD/MIMD; ATTENTION; PROCESSOR; DESIGN;
D O I
10.1109/TCSVT.2009.2031516
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As object recognition requires huge computation power to deal with complex image processing tasks, it is very challenging to meet real-time processing demands under low-power constraints for embedded systems. In this paper, a configurable heterogeneous multicore architecture with a dual-mode linear processor array and a cellular neural network on the network-on-chip platform is presented for real-time object recognition. The bio-inspired attention-based object recognition algorithm is devised to reduce computational complexity of the object recognition. The cellular neural network is utilized to accelerate the visual attention algorithm for selecting salient image regions rapidly. The dual-mode parallel processor is configured into single instruction, multiple data (SIMD) or multiple-instruction-multiple-data modes to perform data-intensive image processing operations while exploiting pixel-level and feature-level parallelisms required for the attention-based object recognition. The algorithm's hybrid parallelization strategy on the proposed architecture is adopted to obtain maximum performance improvement. The performance analysis results, using a cycle-accurate architecture simulator, show that the proposed architecture achieves a speedup of 2.8 times for the target algorithm over conventional massively parallel SIMD architecture at low hardware cost overhead. A prototype chip of the proposed architecture, fabricated in 0.13 mu m complementary metal-oxide-semiconductor technology, achieves 22 frames/s real-time object recognition with less than 600 mW power consumption.
引用
收藏
页码:1612 / 1622
页数:11
相关论文
共 50 条
  • [1] Real-Time Video Object Recognition Using Convolutional Neural Network
    Ahn, Byungik
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [2] Architecture of a Fully Pipelined Real-Time Cellular Neural Network Emulator
    Yildiz, Nerhun
    Cesur, Evren
    Kayaer, Kamer
    Tavsanoglu, Vedat
    Alpay, Murathan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2015, 62 (01) : 130 - 138
  • [3] Real-time Sign Language Recognition based on Neural Network Architecture
    Mekala, Priyanka
    Gao, Ying
    Fan, Jeffrey
    Davari, Asad
    [J]. PROCEEDINGS SSST 2011: 43RD IEEE SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY, 2011, : 195 - 199
  • [4] Real-Time Object Recognition Algorithm Based on Deep Convolutional Neural Network
    Yang, Lihong
    Wang, Liewei
    Wu, Shuo
    [J]. 2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 331 - 335
  • [5] A New Cellular Neural Network Emulator Architecture Processing Video Real-Time
    Kayaer, Kamer
    Tavsanoglu, Vedat
    [J]. 2009 IEEE 17TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, VOLS 1 AND 2, 2009, : 746 - 749
  • [6] Real-time architecture for neural network applications
    Crespo, A
    Hassan, H
    Andreu, G
    Simo, J
    [J]. REAL TIME PROGRAMMING 1997: (WRTP 97), 1998, : 23 - 28
  • [7] Feature Selection and Neural Network Architecture Evaluation for Real-Time Video Object Classification
    Curtis, Phillip
    Harb, Moufid
    Abielmona, Rami
    Petriu, Emil
    [J]. 2016 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2016, : 1038 - 1045
  • [8] VoxNet: A 3D Convolutional Neural Network for Real-Time Object Recognition
    Maturana, Daniel
    Scherer, Sebastian
    [J]. 2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 922 - 928
  • [9] Implementation of Deep Learning Neural Network for Real-time Object Recognition in OpenCL Framework
    Luo, Yukui
    Li, Shuai
    Sun, Kuangyuan
    Renteria, Raul
    Choi, Ken
    [J]. PROCEEDINGS INTERNATIONAL SOC DESIGN CONFERENCE 2017 (ISOCC 2017), 2017, : 298 - 299
  • [10] Lightweight Network Architecture for Real-Time Action Recognition
    Kozlov, Alexander
    Andronov, Vadim
    Gritsenko, Yana
    [J]. PROCEEDINGS OF THE 35TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING (SAC'20), 2020, : 2074 - 2080