EdgeNet: An End-to-End Deep Neural Network Pretrained with Synthetic Data for a Real-World Autonomous Driving Application

被引:0
|
作者
Miller, Leanne [1 ]
Navarro, Pedro J. [1 ]
Rosique, Francisca [1 ]
机构
[1] Univ Politecn Cartagena, Div Sistemas & Ingn Elect DSIE, Campus Muralla del Mar S-N, Cartagena 30202, Spain
关键词
end-to-end architectures; multimodal synthetic dataset; autonomous driving;
D O I
10.3390/s25010089
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel end-to-end architecture based on edge detection for autonomous driving. The architecture has been designed to bridge the domain gap between synthetic and real-world images for end-to-end autonomous driving applications and includes custom edge detection layers before the Efficient Net convolutional module. To train the architecture, RGB and depth images were used together with inertial data as inputs to predict the driving speed and steering wheel angle. To pretrain the architecture, a synthetic multimodal dataset for autonomous driving applications was created. The dataset includes driving data from 100 diverse weather and traffic scenarios, gathered from multiple sensors including cameras and an IMU as well as from vehicle control variables. The results show that including edge detection layers in the architecture improves performance for transfer learning when using synthetic and real-world data. In addition, pretraining with synthetic data reduces training time and enhances model performance when using real-world data.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] End-to-End Alternating Optimization for Real-World Blind Super Resolution
    Luo, Zhengxiong
    Huang, Yan
    Li, Shang
    Wang, Liang
    Tan, Tieniu
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (12) : 3152 - 3169
  • [42] SOL: An End-to-end Solution for Real-World Remote Monitoring Systems
    Brun-Laguna, Keoma
    Watteyne, Thomas
    Malek, Sami
    Zhang, Ziran
    Oroza, Carlos
    Glaser, Steven D.
    Kerkez, Branko
    2016 IEEE 27TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2016, : 1841 - 1846
  • [43] End-to-End Alternating Optimization for Real-World Blind Super Resolution
    Zhengxiong Luo
    Yan Huang
    Shang Li
    Liang Wang
    Tieniu Tan
    International Journal of Computer Vision, 2023, 131 : 3152 - 3169
  • [44] End-to-end Autonomous Driving in Heterogeneous Traffic Scenario Using Deep Reinforcement Learning
    Chakraborty, Soumyajit
    Kumar, Subhadeep
    Bhatt, Nirav
    Pasumarthy, Ramkrishna
    2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [45] Evolutionary End-to-End Autonomous Driving Model With Continuous-Time Neural Networks
    Du, Jiatong
    Bai, Yulong
    Li, Ye
    Geng, Jiaheng
    Huang, Yanjun
    Chen, Hong
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2024, 29 (04) : 2983 - 2990
  • [46] Learning a Deep Neural Net Policy for End-to-End Control of Autonomous Vehicles
    Rausch, Viktor
    Hansen, Andreas
    Solowjow, Eugen
    Liu, Chang
    Kreuzer, Edwin
    Hedrick, J. Karl
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 4914 - 4919
  • [47] DeepMRS: An End-to-End Deep Neural Network for Dementia Disease Detection using MRS Data
    Ben Ahmed, Olfa
    Fezzani, Seifeddine
    Guillevin, Carole
    Fezai, Lobna
    Naudin, Mathieu
    Gianelli, Benoit
    Fernandez-Maloigne, Christine
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 1459 - 1463
  • [48] DeepVCP: An End-to-End Deep Neural Network for Point Cloud Registration
    Lu, Weixin
    Wan, Guowei
    Zhou, Yao
    Fu, Xiangyu
    Yuan, Pengfei
    Song, Shiyu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 12 - 21
  • [49] End-to-End Driving Activities and Secondary Tasks Recognition Using Deep Convolutional Neural Network and Transfer Learning
    Xing, Yang
    Tang, Jianlin
    Liu, Hong
    Lv, Chen
    Cao, Dongpu
    Velenis, Efstathios
    Wang, Fei-Yue
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1626 - 1631
  • [50] End-to-End Deep Neural Network for Illumination Consistency and Global Illumination
    Huang Jingtao
    Komuro, Takashi
    ADVANCES IN VISUAL COMPUTING, ISVC 2022, PT I, 2022, 13598 : 392 - 403