Power Efficient Object Detector with an Event-Driven Camera for Moving Object Surveillance on an FPGA

被引:2
|
作者
Shimoda, Masayuki [1 ]
Sato, Shimpei [1 ]
Nakahara, Hiroki [1 ]
机构
[1] Tokyo Inst Technol, Tokyo 1528550, Japan
关键词
event-driven camera; object detector; all binarized convolutional neural network; FPGA; NETWORKS;
D O I
10.1587/transinf.2018RCP0005
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an object detector using a sliding window method for an event-driven camera which outputs a subtracted frame (usually a binary value) when changes are detected in captured images. Since sliding window skips unchanged portions of the output, the number of target object area candidates decreases dramatically, which means that our system operates faster and with lower power consumption than a system using a straightforward sliding window approach. Since the event-driven camera output consists of binary precision frames, an all binarized convolutional neural network (ABCNN) can be available, which means that it allows all convolutional layers to share the same binarized convolutional circuit, thereby reducing the area requirement. We implemented our proposed method on the Xilinx Inc. Zedboard and then evaluated it using the PETS 2009 dataset. The results showed that our system outperformed BCNN system from the viewpoint of detection performance, hardware requirement, and computation time. Also, we showed that FPGA is an ideal method for our system than mobile GPU. From these results, our proposed system is more suitable for the embedded systems based on stationary cameras (such as security cameras).
引用
收藏
页码:1020 / 1028
页数:9
相关论文
共 50 条
  • [1] Power Efficient Object Detector with an Event-Driven Camera on an FPGA
    Shimoda, Masayuki
    Sato, Shimpei
    Nakahara, Hiroki
    HEART 2018: PROCEEDINGS OF THE 9TH INTERNATIONAL SYMPOSIUM ON HIGHLY-EFFICIENT ACCELERATORS AND RECONFIGURABLE TECHNOLOGIES, 2018,
  • [2] Efficient, event-driven feature extraction and unsupervised object tracking for embedded applications
    Sengupta, Jonah P.
    Villemur, Martin
    Andreou, Andreas G.
    2021 55TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2021,
  • [3] Event library: An object-oriented library for event-driven design
    Arslan, V
    Nienaltowski, P
    Arnout, K
    MODULAR PROGRAMMING LANGUAGES, PROCEEDINGS, 2003, 2789 : 174 - 183
  • [4] An Event-Driven Power Efficient Surveillance and Lighting System in the Saudi Arabia Perspective
    Jambi, Lamees
    Alsubaie, Sultana
    Qaisar, Saeed Mian
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2018, : 423 - 427
  • [5] The power of abstraction, reuse, and simplicity: An object-oriented library for event-driven design
    Meyer, B
    FROM OBJECT-ORIENTATION TO FORMAL METHODS, 2004, 2635 : 236 - 271
  • [6] Demonstration of Object Detection for Event-driven Cameras on FPGAs and GPUs
    Shimoda, Masayuki
    Sato, Shimpei
    Nakahara, Hiroki
    2018 28TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2018, : 461 - 462
  • [7] A robust event-driven approach to always-on object recognition
    Grimaldi, Antoine
    Boutin, Victor
    Ieng, Sio-Hoi
    Benosman, Ryad
    Perrinet, Laurent U.
    NEURAL NETWORKS, 2024, 178
  • [8] DelveFS - An event-driven semantic file system for object stores
    Vef, Marc-Andre
    Steiner, Rebecca
    Salkhordeh, Reza
    Steinkamp, Joerg
    Vennetier, Florent
    Smigielski, Jean-Francois
    Brinkmann, Andre
    2020 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2020), 2020, : 35 - 46
  • [9] OBJECT-ORIENTED AND EVENT-DRIVEN AUDIO DSP SOLUTION
    Zhao, Xueming
    2014 12TH IEEE INTERNATIONAL CONFERENCE ON SOLID-STATE AND INTEGRATED CIRCUIT TECHNOLOGY (ICSICT), 2014,
  • [10] EVtracker: An Event-Driven Spatiotemporal Method for Dynamic Object Tracking
    Zhang, Shixiong
    Wang, Wenmin
    Li, Honglei
    Zhang, Shenyong
    SENSORS, 2022, 22 (16)