Efficient GEMM Implementation for Vision-Based Object Detection in Autonomous Driving Applications

被引:0
|
作者
Guerrouj, Fatima Zahra [1 ,2 ]
Florez, Sergio Rodriguez [1 ]
Abouzahir, Mohamed [2 ]
El Ouardi, Abdelhafid [1 ]
Ramzi, Mustapha [2 ]
机构
[1] Univ Paris Saclay, CNRS, ENS Paris Saclay, SATIE Lab, Av Sci Batiment 660, F-91190 Gif Sur Yvette, France
[2] Mohamed V Univ Rabat, Higher Sch Technol Sale, Syst Anal Informat Proc & Ind Management Lab, Rabat 8007, Morocco
关键词
YOLOv4; GEMM; FPGA; autonomous driving;
D O I
10.3390/jlpea13020040
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Convolutional Neural Networks (CNNs) have been incredibly effective for object detection tasks. YOLOv4 is a state-of-the-art object detection algorithm designed for embedded systems. It is based on YOLOv3 and has improved accuracy, speed, and robustness. However, deploying CNNs on embedded systems such as Field Programmable Gate Arrays (FPGAs) is difficult due to their limited resources. To address this issue, FPGA-based CNN architectures have been developed to improve the resource utilization of CNNs, resulting in improved accuracy and speed. This paper examines the use of General Matrix Multiplication Operations (GEMM) to accelerate the execution of YOLOv4 on embedded systems. It reviews the most recent GEMM implementations and evaluates their accuracy and robustness. It also discusses the challenges of deploying YOLOv4 on autonomous vehicle datasets. Finally, the paper presents a case study demonstrating the successful implementation of YOLOv4 on an Intel Arria 10 embedded system using GEMM.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Efficient deep network for vision-based object detection in robotic applications
    Lu, Keyu
    An, Xiangjing
    Li, Jian
    He, Hangen
    [J]. NEUROCOMPUTING, 2017, 245 : 31 - 45
  • [2] Monocular Vision-based Object Recognition for Autonomous Vehicle Driving in a Real Driving Environment
    Jeon, Jeongmin
    Hwang, Sung-Ho
    Moon, Hyungpil
    [J]. 2016 13TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2016, : 393 - 399
  • [3] Vision-based environmental perception for autonomous driving
    Liu, Fei
    Lu, Zihao
    Lin, Xianke
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023,
  • [4] Vision-based object detection and tracking for autonomous navigation of underwater robots
    Lee, Donghwa
    Kim, Gonyop
    Kim, Donghoon
    Myung, Hyun
    Choi, Hyun-Taek
    [J]. OCEAN ENGINEERING, 2012, 48 : 59 - 68
  • [5] Vision-Based Object Detection and Localization for Autonomous Airborne Payload Delivery
    Sewell, James
    Van Niekerk, Theo
    Phillips, Russell
    Mooney, Paul
    Stopforth, Riaan
    [J]. CONTROLO 2020, 2021, 695 : 602 - 615
  • [6] Stereo Vision-Based Convolutional Networks for Object Detection in Driving Environments
    Guindel, Carlos
    Martin, David
    Maria Armingol, Jose
    [J]. COMPUTER AIDED SYSTEMS THEORY - EUROCAST 2017, PT II, 2018, 10672 : 427 - 434
  • [7] Reconstruction-Based Adversarial Attack Detection in Vision-Based Autonomous Driving Systems
    Hussain, Manzoor
    Hong, Jang-Eui
    [J]. MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2023, 5 (04): : 1589 - 1611
  • [8] A Survey of Vision-based Object Detection
    Ge, Naiming
    Yong, Yin
    [J]. 2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 240 - 244
  • [9] Vision-Based Autonomous Driving: A Model Learning Approach
    Baheri, Ali
    Kolmanovsky, Ilya
    Girard, Anouck
    Tseng, H. Eric
    Filev, Dimitar
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2520 - 2525
  • [10] A DISCRIMINATING FEATURE TRACKER FOR VISION-BASED AUTONOMOUS DRIVING
    SCHNEIDERMAN, H
    NASHMAN, M
    [J]. IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1994, 10 (06): : 769 - 775