Robust Autonomous Driving Control using Auto-Encoder and End-to-End Deep Learning under Rainy Conditions

被引:10
|
作者
Phuc Phan Hong [1 ]
Anh Nguyen Quoc [1 ]
Luyl-Da Quach [1 ]
Hoang Tran Ngoc [1 ]
机构
[1] FPT Univ, Can Tho, Vietnam
关键词
Autonomous Vehicle; Self-Driving System; Convolutional neural networks; Deep Learning; Computer Vision; Behavioural Cloning; Image processing; Ain removal; Autoencoder;
D O I
10.1145/3591569.3591616
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A key element of autonomous vehicles is lane-keeping. To keep an automobile in its lane, numerous artificial intelligence technologies and vision systems are employed. Despite being widely used, current systems function effectively in favorable weather. Downstream computer vision models may perform worse due to rain and other weather-related obstacles. For this reason, rain, snow, and mist noise must be detected, recognized, and removed by vision systems to improve system performance. For these issues, the autoencoder neural network is particularly common. The main goal of using an autoencoder for image deraining is to maintain originality because autoencoders adhere to the backpropagation procedure instead of the traditional techniques, which results in the signal coming out being ultimately the altered version of the input signal. This study covers a method for reducing the amount of rain in photos utilizing image processing, deep learning methods with autoencoder implementation, and end-to-end learning to determine the best steering rotation setting for retaining a vehicle in its lane using a donkey car. After training, the end-to-end model may be able to directly guide the car using the information from the front view camera, unlike the conventional method which manually breaks down the autonomous driving issue into specific details. The convolutional neural network (CNN) model takes raw images as input and generates the proper steering angles. The AI Kit Donkey Car is used in this study to collect data, train models, and evaluate them. According to the experimental results, the combination of the deraining method and end-to-end deep learning produces good performance in rainy situations.
引用
收藏
页码:271 / 278
页数:8
相关论文
共 50 条
  • [31] An End-to-End Curriculum Learning Approach for Autonomous Driving Scenarios
    Anzalone, Luca
    Barra, Paola
    Barra, Silvio
    Castiglione, Aniello
    Nappi, Michele
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19817 - 19826
  • [32] Explaining Autonomous Driving by Learning End-to-End Visual Attention
    Cultrera, Luca
    Seidenari, Lorenzo
    Becattini, Federico
    Pala, Pietro
    Del Bimbo, Alberto
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1389 - 1398
  • [33] Learning a Deep Neural Net Policy for End-to-End Control of Autonomous Vehicles
    Rausch, Viktor
    Hansen, Andreas
    Solowjow, Eugen
    Liu, Chang
    Kreuzer, Edwin
    Hedrick, J. Karl
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 4914 - 4919
  • [34] End-to-End Deep Learning Model for Steering Angle Control of Autonomous Vehicles
    Khanum, Abida
    Lee, Chao-Yang
    Yang, Chu-Sing
    2020 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C 2020), 2021, : 189 - 192
  • [35] Robust Behavioral Cloning for Autonomous Vehicles Using End-to-End Imitation Learning
    Samak T.V.
    Samak C.V.
    Kandhasamy S.
    SAE International Journal of Connected and Automated Vehicles, 2021, 4 (03):
  • [36] Fiber Nonlinearity Mitigation Scheme based on Geometric Constellation Shaping via End-to-end Auto-encoder Learning and KNN Deciding
    Zang, Yuanru
    Zhao, Yan
    Chen, Xue
    2020 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP) AND INTERNATIONAL CONFERENCE ON INFORMATION PHOTONICS AND OPTICAL COMMUNICATIONS (IPOC), 2020,
  • [37] HierTTS: Expressive End-to-End Text-to-Waveform Using a Multi-Scale Hierarchical Variational Auto-Encoder
    Shang, Zengqiang
    Shi, Peiyang
    Zhang, Pengyuan
    Wang, Li
    Zhao, Guangying
    APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [38] Model-Based: End-to-End Molecular Communication System Through Deep Reinforcement Learning Auto Encoder
    Mohamed, Soha
    Dong, Jian
    Junejo, A. R.
    Zuo, De Cheng
    IEEE ACCESS, 2019, 7 : 70279 - 70286
  • [39] Integrating Modular Pipelines with End-to-End Learning: A Hybrid Approach for Robust and Reliable Autonomous Driving Systems
    Rosero, Luis Alberto
    Gomes, Iago Pacheco
    da Silva, Junior Anderson Rodrigues
    Przewodowski, Carlos Andre
    Wolf, Denis Fernando
    Osorio, Fernando Santos
    SENSORS, 2024, 24 (07)
  • [40] Evaluation of End-To-End Learning for Autonomous Driving: The Good, the Bad and the Ugly
    Varisteas, Georgios
    Frank, Raphael
    Alamdari, Seyed Amin Sajadi
    Voos, Holger
    State, Radu
    2019 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2019), 2019, : 110 - 117