EdgeNet: An End-to-End Deep Neural Network Pretrained with Synthetic Data for a Real-World Autonomous Driving Application

被引:0
|
作者
Miller, Leanne [1 ]
Navarro, Pedro J. [1 ]
Rosique, Francisca [1 ]
机构
[1] Univ Politecn Cartagena, Div Sistemas & Ingn Elect DSIE, Campus Muralla del Mar S-N, Cartagena 30202, Spain
关键词
end-to-end architectures; multimodal synthetic dataset; autonomous driving;
D O I
10.3390/s25010089
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel end-to-end architecture based on edge detection for autonomous driving. The architecture has been designed to bridge the domain gap between synthetic and real-world images for end-to-end autonomous driving applications and includes custom edge detection layers before the Efficient Net convolutional module. To train the architecture, RGB and depth images were used together with inertial data as inputs to predict the driving speed and steering wheel angle. To pretrain the architecture, a synthetic multimodal dataset for autonomous driving applications was created. The dataset includes driving data from 100 diverse weather and traffic scenarios, gathered from multiple sensors including cameras and an IMU as well as from vehicle control variables. The results show that including edge detection layers in the architecture improves performance for transfer learning when using synthetic and real-world data. In addition, pretraining with synthetic data reduces training time and enhances model performance when using real-world data.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] End-to-end multimodal affect recognition in real-world environments
    Tzirakis, Panagiotis
    Chen, Jiaxin
    Zafeiriou, Stefanos
    Schuller, Bjorn
    INFORMATION FUSION, 2021, 68 : 46 - 53
  • [32] Recent Advancements in End-to-End Autonomous Driving Using Deep Learning: A Survey
    Chib, Pranav Singh
    Singh, Pravendra
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 103 - 118
  • [33] Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning
    Chen, Jianyu
    Li, Shengbo Eben
    Tomizuka, Masayoshi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 5068 - 5078
  • [34] Autonomous driving in traffic with end-to-end vision-based deep learning
    Paniego, Sergio
    Shinohara, Enrique
    Canas, Josemaria
    NEUROCOMPUTING, 2024, 594
  • [35] Enhancing scene understanding based on deep learning for end-to-end autonomous driving
    Hu, Jie
    Kong, Huifang
    Zhang, Qian
    Liu, Runwu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [36] Visual Navigation in Real-World Indoor Environments Using End-to-End Deep Reinforcement Learning
    Kulhanek, Jonas
    Derner, Erik
    Babuska, Robert
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 4345 - 4352
  • [37] COPDxNet: An End-to-End Deep Neural Network for COPD Detection
    Rabby, A.
    Saha, P.
    Nakhmani, A.
    Reinhardt, J. M.
    Zhang, C.
    Bhatt, S. P.
    Bodduluri, S.
    AMERICAN JOURNAL OF RESPIRATORY AND CRITICAL CARE MEDICINE, 2024, 209
  • [38] An End-to-End Deep Neural Network for Facial Emotion Classification
    Jalal, Md Asif
    Mihaylova, Lyudmila
    Moore, Roger K.
    2019 22ND INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2019), 2019,
  • [39] End-to-End Hardware Accelerator for Deep Convolutional Neural Network
    Chang, Tian-Sheuan
    2018 INTERNATIONAL SYMPOSIUM ON VLSI DESIGN, AUTOMATION AND TEST (VLSI-DAT), 2018,
  • [40] DEEP FMRI: AN END-TO-END DEEP NETWORK FOR CLASSIFICATION OF FMRI DATA
    Riaz, Atif
    Asad, Muhammad
    Al Arif, S. M. Masudur Rahman
    Alonso, Eduardo
    Dima, Danai
    Corr, Philip
    Slabaugh, Greg
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1419 - 1422