Multi-Scale Context Attention Network for Stereo Matching

被引:15
|
作者
Sang, Haiwei [1 ,2 ]
Wang, Quanhong [3 ]
Zhao, Yong [1 ,2 ,3 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, Guiyang 550025, Guizhou, Peoples R China
[2] Guizhou Educ Univ, Sch Math & Big Data, Guiyang 550018, Guizhou, Peoples R China
[3] Peking Univ, Shenzhen Grad Sch, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
关键词
Multi-scale; richer convolutional; atrous spatial pyramid pooling attention; attention mechanism; online hard point mining; IMAGE SEGMENTATION; FEATURES;
D O I
10.1109/ACCESS.2019.2895271
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, many works for stereo matching with convolutional neural networks have gained satisfactory performance. However, it is still an urgent challenge to deal with ill-posed regions and improve details in disparity maps. To address these problems, we propose a multi-scale context attention network with three main modules: atrous spatial pyramid pooling attention, richer convolutional features, and attention mechanism. First, we propose an atrous spatial pyramid pooling attention module to capture context information by the aggregating context in different scales, meanwhile take advantage of the attention mechanism to selectively emphasize informative features and suppress fewer ones. Then, the richer convolutional module is proposed to bring useful detail information for the network. Additionally, attention mechanism is used to pick out informative features for disparity refinement sub-network. Furthermore, we design a point-specific loss function strategy to perform online hard point mining, which helps the network to improve the accuracy of disparity maps. The experiments on the FlyingThings3D and KITTI 2015 benchmark demonstrate that the proposed method can achieve state-of-the-art performance.
引用
收藏
页码:15152 / 15161
页数:10
相关论文
共 50 条
  • [1] Multi-Scale Dense Attention Network for Stereo Matching
    Chang, Yuhui
    Xu, Jiangtao
    Gao, Zhiyuan
    ELECTRONICS, 2020, 9 (11) : 1 - 12
  • [2] Multi-Scale Cost Attention and Adaptive Fusion Stereo Matching Network
    Liu, Zhenguo
    Li, Zhao
    Ao, Wengang
    Zhang, Shaoshuang
    Liu, Wenlong
    He, Yizhi
    ELECTRONICS, 2023, 12 (07)
  • [3] Multi-scale inputs and context-aware aggregation network for stereo matching
    Shi, Liqing
    Xiong, Taiping
    Cui, Gengshen
    Pan, Minghua
    Cheng, Nuo
    Wu, Xiangjie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (30) : 75171 - 75194
  • [4] Multi-scale graph neural network for global stereo matching
    Wang, Xiaofeng
    Yu, Jun
    Sun, Zhiheng
    Sun, Jiameng
    Su, Yingying
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 118
  • [5] MPANET: MULTI-SCALE PYRAMID AGGREGATION NETWORK FOR STEREO MATCHING
    Zhu, Ziyu
    Guo, Wei
    Chen, Wei
    Li, Qiuping
    Zhao, Yong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2773 - 2777
  • [6] Multi-Scale Cost Volumes Cascade Network for Stereo Matching
    Jia, Xiaogang
    Chen, Wei
    Liang, Chen Li Zhengfa
    Wu, Mingfei
    Tan, Yusong
    Huang, Libo
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 8657 - 8663
  • [7] Multi-Scale Context Attention Network for Image Retrieval
    Lou, Yihang
    Bai, Yan
    Wang, Shiqi
    Duan, Ling-Yu
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1128 - 1136
  • [8] Multi-scale Cross-form Pyramid Network for Stereo Matching
    Zhu, Zhidong
    He, Mingyi
    Dai, Yuchao
    Rao, Zhibo
    Li, Bo
    PROCEEDINGS OF THE 2019 14TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2019), 2019, : 1789 - 1794
  • [9] Self-adaptive Multi-scale Aggregation Network for Stereo Matching
    Li, Pengfei
    Ye, Shuiqiang
    Zhang, Jiaquan
    Wang Xinan
    Dai, Qifei
    Yu, Zhengzhong
    Li, Fuchi
    Zhao, Yong
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3794 - 3800
  • [10] Anisotropic stereo matching with multi-scale information
    Li Y.
    Wu M.
    Liu K.
    Yu W.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2023, 29 (09): : 2920 - 2928