Multi-Scale Context Attention Network for Stereo Matching

被引:15
|
作者
Sang, Haiwei [1 ,2 ]
Wang, Quanhong [3 ]
Zhao, Yong [1 ,2 ,3 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, Guiyang 550025, Guizhou, Peoples R China
[2] Guizhou Educ Univ, Sch Math & Big Data, Guiyang 550018, Guizhou, Peoples R China
[3] Peking Univ, Shenzhen Grad Sch, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
关键词
Multi-scale; richer convolutional; atrous spatial pyramid pooling attention; attention mechanism; online hard point mining; IMAGE SEGMENTATION; FEATURES;
D O I
10.1109/ACCESS.2019.2895271
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, many works for stereo matching with convolutional neural networks have gained satisfactory performance. However, it is still an urgent challenge to deal with ill-posed regions and improve details in disparity maps. To address these problems, we propose a multi-scale context attention network with three main modules: atrous spatial pyramid pooling attention, richer convolutional features, and attention mechanism. First, we propose an atrous spatial pyramid pooling attention module to capture context information by the aggregating context in different scales, meanwhile take advantage of the attention mechanism to selectively emphasize informative features and suppress fewer ones. Then, the richer convolutional module is proposed to bring useful detail information for the network. Additionally, attention mechanism is used to pick out informative features for disparity refinement sub-network. Furthermore, we design a point-specific loss function strategy to perform online hard point mining, which helps the network to improve the accuracy of disparity maps. The experiments on the FlyingThings3D and KITTI 2015 benchmark demonstrate that the proposed method can achieve state-of-the-art performance.
引用
收藏
页码:15152 / 15161
页数:10
相关论文
共 50 条
  • [21] Edge supervision and multi-scale cost volume for stereo matching
    Yang, Xiaowei
    Feng, Zhiguo
    Zhao, Yong
    Zhang, Guiying
    He, Lin
    IMAGE AND VISION COMPUTING, 2022, 117
  • [22] Image Stereo Matching Based on Multi-scale Plane set
    Jiang, Xin-hui
    Yu, Shao-jun
    Jiang, Xing
    ADVANCES IN APPLIED SCIENCE, ENGINEERING AND TECHNOLOGY, 2013, 709 : 527 - 533
  • [23] Multi-scale Edge Extraction Based Stereo Matching Algorithm
    Lian, Jing
    Li, Linhui
    Shen, Xiaoyong
    Hao, Xianpeng
    FRONTIERS OF MANUFACTURING AND DESIGN SCIENCE, PTS 1-4, 2011, 44-47 : 4162 - +
  • [24] Stereo Matching with Multi-scale Based on Anisotropic Match Cost
    Liu, Huaiguang
    Cai, Yu
    Zhou, Shiyang
    Yang, Jintang
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (24):
  • [25] LMNet: A learnable multi-scale cost volume for stereo matching
    Liu, Jiatao
    Zhang, Yaping
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 128
  • [26] Multi-Scale Context Aggregation Network with Attention-Guided for Crowd Counting
    Wang, Xin
    Lv, Rongrong
    Zhao, Yang
    Yang, Tangwen
    Ruan, Qiuqi
    PROCEEDINGS OF 2020 IEEE 15TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2020), 2020, : 240 - 245
  • [27] Coarse-to-Fine Stereo Matching Network Based on Multi-Scale Structural Information Filtrating
    Bi, Yuanwei
    Li, Chuanbiao
    Zheng, Qiang
    Wang, Guohui
    Xu, Shidong
    Wang, Weiyuan
    IEEE ACCESS, 2023, 11 : 83692 - 83702
  • [28] Efficient Multi-Scale Stereo-Matching Network Using Adaptive Cost Volume Filtering
    Jeon, Suyeon
    Heo, Yong Seok
    SENSORS, 2022, 22 (15)
  • [29] A Fast Stereo Matching Network with Multi-Cross Attention
    Wei, Ming
    Zhu, Ming
    Wu, Yi
    Sun, Jiaqi
    Wang, Jiarong
    Liu, Changji
    SENSORS, 2021, 21 (18)
  • [30] Siamese Network with Multi-scale Feature Fusion and Dual Attention Mechanism for Template Matching
    Zhao, Kai
    He, Binbing
    Pan, Shiju
    Zhu, Yuan
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6588 - 6592