Robust Autonomous Driving Control using Auto-Encoder and End-to-End Deep Learning under Rainy Conditions

被引:10
|
作者
Phuc Phan Hong [1 ]
Anh Nguyen Quoc [1 ]
Luyl-Da Quach [1 ]
Hoang Tran Ngoc [1 ]
机构
[1] FPT Univ, Can Tho, Vietnam
关键词
Autonomous Vehicle; Self-Driving System; Convolutional neural networks; Deep Learning; Computer Vision; Behavioural Cloning; Image processing; Ain removal; Autoencoder;
D O I
10.1145/3591569.3591616
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A key element of autonomous vehicles is lane-keeping. To keep an automobile in its lane, numerous artificial intelligence technologies and vision systems are employed. Despite being widely used, current systems function effectively in favorable weather. Downstream computer vision models may perform worse due to rain and other weather-related obstacles. For this reason, rain, snow, and mist noise must be detected, recognized, and removed by vision systems to improve system performance. For these issues, the autoencoder neural network is particularly common. The main goal of using an autoencoder for image deraining is to maintain originality because autoencoders adhere to the backpropagation procedure instead of the traditional techniques, which results in the signal coming out being ultimately the altered version of the input signal. This study covers a method for reducing the amount of rain in photos utilizing image processing, deep learning methods with autoencoder implementation, and end-to-end learning to determine the best steering rotation setting for retaining a vehicle in its lane using a donkey car. After training, the end-to-end model may be able to directly guide the car using the information from the front view camera, unlike the conventional method which manually breaks down the autonomous driving issue into specific details. The convolutional neural network (CNN) model takes raw images as input and generates the proper steering angles. The AI Kit Donkey Car is used in this study to collect data, train models, and evaluate them. According to the experimental results, the combination of the deraining method and end-to-end deep learning produces good performance in rainy situations.
引用
收藏
页码:271 / 278
页数:8
相关论文
共 50 条
  • [41] End-to-End Learning of Behavioural Inputs for Autonomous Driving in Dense Traffic
    Shrestha, Jatan
    Idoko, Simon
    Sharma, Basant
    Singh, Arun Kumar
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 10020 - 10027
  • [42] Multi-task Learning with Attention for End-to-end Autonomous Driving
    Ishihara, Keishi
    Kanervisto, Anssi
    Miura, Jun
    Hautamaki, Ville
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2896 - 2905
  • [43] End-to-end Autonomous Driving Perception with Sequential Latent Representation Learning
    Chen, Jianyu
    Xu, Zhuo
    Tomizuka, Masayoshi
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 1999 - 2006
  • [44] End-to-End Deep Learning for Autonomous Navigation of Mobile Robot
    Kim, Ye-Hoon
    Jang, Jun-Ik
    Yun, Sojung
    2018 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2018,
  • [45] Eagle: End-to-end Deep Reinforcement Learning based Autonomous Control of PTZ Cameras
    Sandha, Sandeep Singh
    Balaji, Bharathan
    Garcia, Luis
    Srivastava, Mani
    PROCEEDINGS 8TH ACM/IEEE CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION, IOTDI 2023, 2023, : 144 - 157
  • [46] End-to-End Deep Learning for Autonomous Longitudinal and Lateral Control based on Vehicle Dynamics
    Hsu, Tsung-Ming
    Wang, Cheng-Hsien
    Chen, Yu-Rui
    AIVR 2018: 2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY, 2018, : 111 - 114
  • [47] End-to-End Deep Reinforcement Learning for Image-Based UAV Autonomous Control
    Zhao, Jiang
    Sun, Jiaming
    Cai, Zhihao
    Wang, Longhong
    Wang, Yingxun
    APPLIED SCIENCES-BASEL, 2021, 11 (18):
  • [48] Toward End-to-End Control for UAV Autonomous Landing via Deep Reinforcement Learning
    Polvara, Riccardo
    Patacchiola, Massimiliano
    Sharma, Sanjay
    Wan, Jian
    Manning, Andrew
    Sutton, Robert
    Cangelosi, Angelo
    2018 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS), 2018, : 115 - 123
  • [49] Uncertainty Quantification with Statistical Guarantees in End-to-End Autonomous Driving Control
    Michelmore, Rhiannon
    Wicker, Matthew
    Laurenti, Luca
    Cardelli, Luca
    Gal, Yarin
    Kwiatkowska, Marta
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 7344 - 7350
  • [50] End-to-end deep learning of lane detection and path prediction for real-time autonomous driving
    Der-Hau Lee
    Jinn-Liang Liu
    Signal, Image and Video Processing, 2023, 17 : 199 - 205