An end-to-end stereo matching algorithm based on improved convolutional neural network

被引:3
|
作者
Liu, Yan [1 ]
Lv, Bingxue [1 ]
Wang, Yuheng [1 ]
Huang, Wei [1 ]
机构
[1] Zhengzhou Univ Light Ind, Coll Comp & Commun Engn, Zhengzhou 45000, Peoples R China
基金
中国国家自然科学基金;
关键词
image sensor; stereo matching; binocular vision; convolutional neural network; SHAPE MEASUREMENT;
D O I
10.3934/mbe.2020396
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deep end-to-end learning based stereo matching methods have achieved great success as witnessed by the leaderboards across different benchmarking datasets. Depth information in stereo vision systems are obtained by a dense and accurate disparity map, which is computed by a robust stereo matching algorithm. However, previous works adopt network layer with the same size to train the feature parameters and get an unsatisfactory efficiency, which cannot be satisfied for the real scenarios by existing methods. In this paper, we present an end-to-end stereo matching algorithm based on "downsize" convolutional neural network (CNN) for autonomous driving scenarios. Firstly, the road images are feed into the designed CNN to get the depth information. And then the "downsize" full-connection layer combined with subsequent network optimization is employed to improve the accuracy of the algorithm. Finally, the improved loss function is utilized to approximate the similarity of positive and negative samples in a more relaxed constraint to improve the matching effect of the output. The loss function error of the proposed method for KITTI 2012 and KITTI 2015 datasets are reduced to 2.62 and 3.26% respectively, which also reduces the runtime of the proposed algorithm. Experimental results illustrate that the proposed end-to-end algorithm can obtain a dense disparity map and the corresponding depth information can be used for the binocular vision system in autonomous driving scenarios. In addition,our method also achieves better performance when the size of the network is compressed compared with previous methods.
引用
收藏
页码:7787 / 7803
页数:17
相关论文
共 50 条
  • [41] WaveCRN: An Efficient Convolutional Recurrent Neural Network for End-to-End Speech Enhancement
    Hsieh, Tsun-An
    Wang, Hsin-Min
    Lu, Xugang
    Tsao, Yu
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 (27) : 2149 - 2153
  • [42] GuidedNet: Single Image Dehazing Using an End-to-end Convolutional Neural Network
    Goncalves, Lucas T.
    Gaya, Joel O.
    Drews-, Paulo, Jr.
    Botelho, Silvia S. C.
    [J]. PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2018, : 79 - 86
  • [43] End-to-end Learning Approach for Autonomous Driving: A Convolutional Neural Network Model
    Wang, Yaqin
    Liu, Dongfang
    Jeon, Hyewon
    Chu, Zhiwei
    Matson, Eric T.
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 833 - 839
  • [44] An End-to-End System for Automatic Urinary Particle Recognition with Convolutional Neural Network
    Yixiong Liang
    Rui Kang
    Chunyan Lian
    Yuan Mao
    [J]. Journal of Medical Systems, 2018, 42
  • [45] An End-To-End Seizure Prediction Method Using Convolutional Neural Network and Transformer
    Wang, Yiyuan
    Zhao, Wenshan
    [J]. 12TH ASIAN-PACIFIC CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING, VOL 2, APCMBE 2023, 2024, 104 : 317 - 324
  • [46] An End-to-End System for Automatic Urinary Particle Recognition with Convolutional Neural Network
    Liang, Yixiong
    Kang, Rui
    Lian, Chunyan
    Mao, Yuan
    [J]. JOURNAL OF MEDICAL SYSTEMS, 2018, 42 (09)
  • [47] End-to-End Navigation with Branch Turning Support using Convolutional Neural Network
    Seiya, Shunya
    Carballo, Alexander
    Takeuchi, Eijiro
    Miyajima, Chiyomi
    Takeda, Kazuya
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 499 - 506
  • [48] EENED: End-to-End Neural Epilepsy Detection based on Convolutional Transformer
    Liu, Chenyu
    Zhou, Xinliang
    Liu, Yang
    [J]. 2023 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI, 2023, : 368 - 371
  • [49] An Effective End-to-End Image Matching Network with Attentional Graph Neural Networks
    Fu, Kuiyuan
    Liu, Zhong
    Wu, Xingming
    Sun, Chongshang
    Chen, Weihai
    [J]. 2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 1628 - 1633
  • [50] Compact convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
    Izzuddin, Tarmizi Ahmad
    Safri, Norlaili Mat
    Othman, Mohd Afzan
    [J]. BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2021, 41 (04) : 1629 - 1645