3D Convolution Channel Compression for Stereo Matching

被引:0
|
作者
Wang, Tengfei [1 ]
Lu, Yang [1 ,2 ]
Zhang, Zhou [1 ]
Wei, Xing [1 ,3 ]
Wei, Zhen [1 ,3 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Mine IOT & Secur Monitoring Technol Key Lab, Hefei 230088, Peoples R China
[3] Hefei Univ Technol, Intelligent Mfg Inst, Hefei 230009, Peoples R China
关键词
Stereo Matching; Disparity Estimation; Depth Estimation; Model Compression; Cost Aggregation; SCENE FLOW;
D O I
10.1007/978-981-97-5591-2_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many deep models for stereo matching employ 3D convolutions for cost aggregation to achieve better performance. However, this approach requires substantial computational and memory resources, limiting the deployment of the model on edge devices. In this paper, we analyze the challenges of channel compression in stereo matching models and adopt a straightforward and efficient compression method. Ourmethod focuses on the channel compression of the cost aggregation module, enabling the model to achieve acceleration on existing hardware, reducing significantly computational cost. We set a hyperparameter. that decides the compression rate, and compress the channels of each layer in cost aggregation module according to it. This method ensures the consistency for irregular skip connections. We extensively test our method on GwcNet, PSMNet and CFNet on multiple datasets, achieving promising results. We believe that the proposed compression method allows stereo matching models to better balance computational cost and accuracy during various degrees of channel compression, making them more suitable for deployment on edge devices.
引用
收藏
页码:49 / 61
页数:13
相关论文
共 50 条
  • [1] A Hybrid 2D and 3D Convolution Neural Network for Stereo Matching
    Zeng, Xuan
    Li, Yewen
    Chen, Ziqian
    Zhu, Liping
    2018 21ST IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2018), 2018, : 152 - 156
  • [2] Optimizing 3D Convolution Kernels on Stereo Matching for Resource Efficient Computations
    Xiao, Jianqiang
    Ma, Dianbo
    Yamane, Satoshi
    SENSORS, 2021, 21 (20)
  • [3] Stereo Matching for 3D Building Reconstruction
    Gupta, Gaurav
    Balasubramanian, R.
    Rawat, M. S.
    Bhargava, R.
    Krishna, B. Gopala
    ADVANCES IN COMPUTING, COMMUNICATION AND CONTROL, 2011, 125 : 522 - +
  • [4] Trainable 3D Recognition Using Stereo Matching
    Castillo, Carlos D.
    Jacobs, David W.
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS), 2011,
  • [5] Rethinking 3D cost aggregation in stereo matching
    Gan, Wanshui
    Wu, Wenhao
    Chen, Shifeng
    Zhao, Yuxiang
    Wong, Pak Kin
    PATTERN RECOGNITION LETTERS, 2023, 167 : 75 - 81
  • [6] Stereo Matching based 3D Model Reconstruction
    Yuan, Lijie
    Tie, Yun
    Qi, Lin
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806
  • [7] STEREO VIDEO COMPRESSION FOR MOBILE 3D SERVICES
    Merkle, P.
    Brust, H.
    Dix, K.
    Mueller, K.
    Wiegand, T.
    2009 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO, 2009, : 141 - 144
  • [8] Lossless Compression of Stereo Disparity Maps for 3D
    Zamarin, Marco
    Forchhammer, Soren
    2012 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2012, : 617 - 622
  • [9] A Miniature Binocular Endoscope with Local Feature Matching and Stereo Matching for 3D Measurement and 3D Reconstruction
    Wang, Di
    Liu, Hua
    Cheng, Xiang
    SENSORS, 2018, 18 (07)
  • [10] Topology matching for 3D video compression
    Tung, Tony
    Schmitt, Francis
    Matsuyama, Takashi
    2007 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-8, 2007, : 2486 - +