EdgeNet: An End-to-End Deep Neural Network Pretrained with Synthetic Data for a Real-World Autonomous Driving Application

被引:0
|
作者
Miller, Leanne [1 ]
Navarro, Pedro J. [1 ]
Rosique, Francisca [1 ]
机构
[1] Univ Politecn Cartagena, Div Sistemas & Ingn Elect DSIE, Campus Muralla del Mar S-N, Cartagena 30202, Spain
关键词
end-to-end architectures; multimodal synthetic dataset; autonomous driving;
D O I
10.3390/s25010089
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel end-to-end architecture based on edge detection for autonomous driving. The architecture has been designed to bridge the domain gap between synthetic and real-world images for end-to-end autonomous driving applications and includes custom edge detection layers before the Efficient Net convolutional module. To train the architecture, RGB and depth images were used together with inertial data as inputs to predict the driving speed and steering wheel angle. To pretrain the architecture, a synthetic multimodal dataset for autonomous driving applications was created. The dataset includes driving data from 100 diverse weather and traffic scenarios, gathered from multiple sensors including cameras and an IMU as well as from vehicle control variables. The results show that including edge detection layers in the architecture improves performance for transfer learning when using synthetic and real-world data. In addition, pretraining with synthetic data reduces training time and enhances model performance when using real-world data.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Robust Neural Network for Sim-to-Real Gap in End-to-End Autonomous Driving
    Pareigis, Stephan
    Maass, Fynn Luca
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (ICINCO), 2022, : 113 - 119
  • [2] An End-to-End Deep Neural Network for Autonomous Driving Designed for Embedded Automotive Platforms
    Kocic, Jelena
    Jovicic, Nenad
    Drndarevic, Vujo
    SENSORS, 2019, 19 (09)
  • [3] End-to-end autonomous driving based on the convolution neural network model
    Zhao, Yuanfang
    Chen, Yunli
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 419 - 423
  • [4] Hammer: A Real-world, End-to-end Network Traffic Simulator
    Prevezanos, Ioannis
    Angelou, Andreas
    Tselios, Christos
    Stergiakis, Alexandros
    Tsogkas, Vassilis
    Tsolis, George
    2017 IEEE 22ND INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2017,
  • [5] End-to-End Deep Neural Network Architectures for Speed and Steering Wheel Angle Prediction in Autonomous Driving
    Navarro, Pedro J.
    Miller, Leanne
    Rosique, Francisca
    Fernandez-Isla, Carlos
    Gila-Navarro, Alberto
    ELECTRONICS, 2021, 10 (11)
  • [6] Building an Autonomous Lane Keeping Simulator Using Real-World Data and End-to-End Learning
    Chen, Zhilu
    Li, Lening
    Huang, Xinming
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2020, 12 (01) : 47 - 59
  • [7] End-to-end Learning Approach for Autonomous Driving: A Convolutional Neural Network Model
    Wang, Yaqin
    Liu, Dongfang
    Jeon, Hyewon
    Chu, Zhiwei
    Matson, Eric T.
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 833 - 839
  • [8] SynFog: A Photo-realistic Synthetic Fog Dataset based on End-to-end Imaging Simulation for Advancing Real-World Defogging in Autonomous Driving
    Xie, Yiming
    Wei, Henglu
    Liu, Zhenyi
    Wang, Xiaoyu
    Ji, Xiangyang
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 21763 - 21772
  • [9] GALNet: An End-to-End Deep Neural Network for Ground Localization of Autonomous Cars
    Mendoza, Ricardo Carrillo
    Cao, Bingyi
    Goehring, Daniel
    Rojas, Raul
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ROBOTICS, COMPUTER VISION AND INTELLIGENT SYSTEMS (ROBOVIS), 2020, : 39 - 50
  • [10] End-to-End Autonomous Driving Through Dueling Double Deep Q-Network
    Peng, Baiyu
    Sun, Qi
    Li, Shengbo Eben
    Kum, Dongsuk
    Yin, Yuming
    Wei, Junqing
    Gu, Tianyu
    AUTOMOTIVE INNOVATION, 2021, 4 (03) : 328 - 337