An end-to-end stereo matching algorithm based on improved convolutional neural network

被引:3
|
作者
Liu, Yan [1 ]
Lv, Bingxue [1 ]
Wang, Yuheng [1 ]
Huang, Wei [1 ]
机构
[1] Zhengzhou Univ Light Ind, Coll Comp & Commun Engn, Zhengzhou 45000, Peoples R China
基金
中国国家自然科学基金;
关键词
image sensor; stereo matching; binocular vision; convolutional neural network; SHAPE MEASUREMENT;
D O I
10.3934/mbe.2020396
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deep end-to-end learning based stereo matching methods have achieved great success as witnessed by the leaderboards across different benchmarking datasets. Depth information in stereo vision systems are obtained by a dense and accurate disparity map, which is computed by a robust stereo matching algorithm. However, previous works adopt network layer with the same size to train the feature parameters and get an unsatisfactory efficiency, which cannot be satisfied for the real scenarios by existing methods. In this paper, we present an end-to-end stereo matching algorithm based on "downsize" convolutional neural network (CNN) for autonomous driving scenarios. Firstly, the road images are feed into the designed CNN to get the depth information. And then the "downsize" full-connection layer combined with subsequent network optimization is employed to improve the accuracy of the algorithm. Finally, the improved loss function is utilized to approximate the similarity of positive and negative samples in a more relaxed constraint to improve the matching effect of the output. The loss function error of the proposed method for KITTI 2012 and KITTI 2015 datasets are reduced to 2.62 and 3.26% respectively, which also reduces the runtime of the proposed algorithm. Experimental results illustrate that the proposed end-to-end algorithm can obtain a dense disparity map and the corresponding depth information can be used for the binocular vision system in autonomous driving scenarios. In addition,our method also achieves better performance when the size of the network is compressed compared with previous methods.
引用
收藏
页码:7787 / 7803
页数:17
相关论文
共 50 条
  • [1] An end-to-end stereo matching algorithm based on improved convolutional neural network
    Liu, Yan
    Lv, Bingxue
    Wang, Yuheng
    Huang, Wei
    [J]. Mathematical Biosciences and Engineering, 2020, 17 (06): : 7787 - 7803
  • [2] End-to-end dense stereo matching based on full convolutional neural network
    Kang, Junhua
    [J]. Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2022, 51 (05):
  • [3] Matching Large Baseline Oblique Stereo Images Using an End-to-End Convolutional Neural Network
    Yao, Guobiao
    Yilmaz, Alper
    Zhang, Li
    Meng, Fei
    Ai, Haibin
    Jin, Fengxiang
    [J]. REMOTE SENSING, 2021, 13 (02) : 1 - 22
  • [4] Stereo matching algorithm based on improved convolutional neural network
    Zhu, S. P.
    Xu, H.
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2018, 123 : 40 - 40
  • [5] Lightweight end-to-end image steganalysis based on convolutional neural network
    Wang, Qun
    Zhang, Minqing
    Li, Jun
    Kong, Yongjun
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (06)
  • [6] Improvement of AnyNet-based end-to-end phased binocular stereo matching network
    Chen, Sizhe
    Ergu, Daji
    Ma, Bo
    Cai, Ying
    Liu, Fangyao
    [J]. 8TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT (ITQM 2020 & 2021): DEVELOPING GLOBAL DIGITAL ECONOMY AFTER COVID-19, 2022, 199 : 1450 - 1457
  • [7] A Robust End-to-End Speckle Stereo Matching Network for Industrial Scenes
    Liu, Yunxuan
    Yang, Kai
    Li, Xinyu
    Bai, Zijian
    Wan, Yingying
    Xie, Liming
    [J]. IEEE ACCESS, 2024, 12 : 6777 - 6789
  • [8] An End-to-End Convolutional Neural Network for ECG-Based Biometric Authentication
    Pinto, Joao Ribeiro
    Cardoso, Jaime S.
    [J]. 2019 IEEE 10TH INTERNATIONAL CONFERENCE ON BIOMETRICS THEORY, APPLICATIONS AND SYSTEMS (BTAS), 2019,
  • [9] Research on End-to-end Voiceprint Recognition Model Based on Convolutional Neural Network
    Hong Zhao
    Yue, Lupeng
    Wang, Weijie
    Zeng Xiangyan
    [J]. JOURNAL OF WEB ENGINEERING, 2021, 20 (05): : 1573 - 1585
  • [10] LEARNING ENVIRONMENTAL SOUNDS WITH END-TO-END CONVOLUTIONAL NEURAL NETWORK
    Tokozume, Yuji
    Harada, Tatsuya
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2721 - 2725