Vision-based environmental perception for autonomous driving

被引:3
|
作者
Liu, Fei [1 ]
Lu, Zihao [1 ]
Lin, Xianke [1 ,2 ]
机构
[1] Ontario Tech Univ, Dept Automot & Mechatron Engn, Oshawa, ON, Canada
[2] Ontario Tech Univ, Dept Automot & Mechatron Engn, 2000 Simcoe St North, Oshawa, ON L1G 0C5, Canada
关键词
Vision sensor; vision SLAM; environmental perception; deep learning; autonomous driving; VEHICLE DETECTION; DEPTH ESTIMATION; SLAM; EFFICIENT; COMPRESSION; ACQUISITION; TRANSFORM; NETWORK;
D O I
10.1177/09544070231203059
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Visual perception plays an important role in autonomous driving. One of the primary tasks is object detection and identification. Since the vision sensor is rich in color and texture information, it can quickly and accurately identify various road information. The commonly used technique is based on extracting and calculating various features of the image. The recent development of deep learning-based method has better reliability and processing speed and has a greater advantage in recognizing complex elements. For depth estimation, vision sensor is also used for ranging due to their small size and low cost. Monocular camera uses image data from a single viewpoint as input to estimate object depth. In contrast, stereo vision is based on parallax and matching feature points of different views, and the application of Deep learning also further improves the accuracy. In addition, Simultaneous Location and Mapping (SLAM) can establish a model of the road environment, thus helping the vehicle perceive the surrounding environment and complete the tasks. In this paper, we introduce and compare various methods of object detection and identification, then explain the development of depth estimation and compare various methods based on monocular, stereo, and RGB-D sensors, next review and compare various methods of SLAM, and finally summarize the current problems and present the future development trends of vision technologies.
引用
收藏
页数:31
相关论文
共 50 条
  • [1] Vision-based Offline-Online Perception Paradigm for Autonomous Driving
    Ros, German
    Ramos, Sebastian
    Granados, Manuel
    Bakhtiary, Amir
    Vazquez, David
    Lopez, Antonio M.
    [J]. 2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, : 231 - 238
  • [2] Attacking vision-based perception in end-to-end autonomous driving models
    Boloor, Adith
    Garimella, Karthik
    He, Xin
    Gill, Christopher
    Vorobeychik, Yevgeniy
    Zhang, Xuan
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2020, 110
  • [3] Vision-based Perception for Autonomous Urban Navigation
    Bansal, Mayank
    Das, Aveek
    Kreutzer, Greg
    Eledath, Jayan
    Kumar, Rakesh
    Sawhney, Harpreet
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2008, : 434 - 440
  • [4] Vision-Based Autonomous Driving: A Model Learning Approach
    Baheri, Ali
    Kolmanovsky, Ilya
    Girard, Anouck
    Tseng, H. Eric
    Filev, Dimitar
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2520 - 2525
  • [5] A DISCRIMINATING FEATURE TRACKER FOR VISION-BASED AUTONOMOUS DRIVING
    SCHNEIDERMAN, H
    NASHMAN, M
    [J]. IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1994, 10 (06): : 769 - 775
  • [6] Navigation Command Matching for Vision-based Autonomous Driving
    Pan, Yuxin
    Xue, Jianru
    Zhang, Pengfei
    Ouyang, Wanli
    Fang, Jianwu
    Chen, Xingyu
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 4343 - 4349
  • [7] An embedded system for vision-based driving environment perception
    Wang, Kunfeng
    Li, Zhenjiang
    Sun, Yuan
    Qiao, Xin
    Wang, Fei-Yue
    [J]. PROCEEDINGS OF THE 2006 IEEE/ASME INTERNATIONAL CONFERENCE ON MECHATRONIC AND EMBEDDED SYSTEMS AND APPLICATIONS, 2006, : 15 - +
  • [8] Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach
    Wang, Jiao
    Sun, Haoyi
    Zhu, Can
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (09) : 11213 - 11226
  • [9] Vision-Based Sensing Systems for Autonomous Driving: Centralized or Decentralized?
    Hirabayashi, Manato
    Saito, Yukihiro
    Murakami, Kosuke
    Ohsato, Akihito
    Kato, Shinpei
    Edahiro, Masato
    [J]. JOURNAL OF ROBOTICS AND MECHATRONICS, 2021, 33 (03) : 686 - 697
  • [10] Monocular Vision-based Object Recognition for Autonomous Vehicle Driving in a Real Driving Environment
    Jeon, Jeongmin
    Hwang, Sung-Ho
    Moon, Hyungpil
    [J]. 2016 13TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2016, : 393 - 399