Multi-Scale Context Attention Network for Stereo Matching

被引:15
|
作者
Sang, Haiwei [1 ,2 ]
Wang, Quanhong [3 ]
Zhao, Yong [1 ,2 ,3 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, Guiyang 550025, Guizhou, Peoples R China
[2] Guizhou Educ Univ, Sch Math & Big Data, Guiyang 550018, Guizhou, Peoples R China
[3] Peking Univ, Shenzhen Grad Sch, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
关键词
Multi-scale; richer convolutional; atrous spatial pyramid pooling attention; attention mechanism; online hard point mining; IMAGE SEGMENTATION; FEATURES;
D O I
10.1109/ACCESS.2019.2895271
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, many works for stereo matching with convolutional neural networks have gained satisfactory performance. However, it is still an urgent challenge to deal with ill-posed regions and improve details in disparity maps. To address these problems, we propose a multi-scale context attention network with three main modules: atrous spatial pyramid pooling attention, richer convolutional features, and attention mechanism. First, we propose an atrous spatial pyramid pooling attention module to capture context information by the aggregating context in different scales, meanwhile take advantage of the attention mechanism to selectively emphasize informative features and suppress fewer ones. Then, the richer convolutional module is proposed to bring useful detail information for the network. Additionally, attention mechanism is used to pick out informative features for disparity refinement sub-network. Furthermore, we design a point-specific loss function strategy to perform online hard point mining, which helps the network to improve the accuracy of disparity maps. The experiments on the FlyingThings3D and KITTI 2015 benchmark demonstrate that the proposed method can achieve state-of-the-art performance.
引用
收藏
页码:15152 / 15161
页数:10
相关论文
共 50 条
  • [31] MULTI-SCALE CASCADE DISPARITY REFINEMENT STEREO NETWORK
    Jia, Xiaogang
    Chen, Wei
    Liang, Zhengfa
    Luo, Xin
    Wu, Mingfei
    Tan, Yusong
    Huang, Libo
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2110 - 2114
  • [32] RMAFF-PSN: A Residual Multi-Scale Attention Feature Fusion Photometric Stereo Network
    Luo, Kai
    Ju, Yakun
    Qi, Lin
    Wang, Kaixuan
    Dong, Junyu
    PHOTONICS, 2023, 10 (05)
  • [33] Multi-Scale Attention Network for Image Cropping
    Lian, Tianpei
    Xian, Ke
    Pan, Zhiyu
    Hong, Chaoyi
    Cao, Zhiguo
    Zhong, Weicai
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2640 - 2645
  • [34] Multi-scale Refocusing Attention Siamese Network
    Liu, Guoqiang
    Chen, Zhe
    Shen, Guangze
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 42 - 46
  • [35] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [36] MCDAN: A Multi-Scale Context-Enhanced Dynamic Attention Network for Diffusion Prediction
    Wang, Xiaowen
    Wang, Lanjun
    Su, Yuting
    Zhang, Yongdong
    Liu, An-An
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7850 - 7862
  • [37] Joint Bilateral Filter and Multi-Scale Cost Aggregation in Stereo Matching
    Ye You-ping
    Zheng Hong
    Chen Hao
    Yang Yu
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON MECHATRONICS, MATERIALS, CHEMISTRY AND COMPUTER ENGINEERING 2015 (ICMMCCE 2015), 2015, 39 : 2945 - 2948
  • [38] CONTEXT-AWARE HIERARCHICAL FEATURE ATTENTION NETWORK FOR MULTI-SCALE OBJECT DETECTION
    Xu, Xuelong
    Luo, Xiangfeng
    Ma, Liyan
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2011 - 2015
  • [39] Novel Stereo Matching Method on Multi-scale Harris Corner Points
    Fan Tiesheng
    Niu Bing
    Wang Qingsong
    Wang Tao
    Qu Dapeng
    ISCSCT 2008: INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND COMPUTATIONAL TECHNOLOGY, VOL 1, PROCEEDINGS, 2008, : 167 - 170
  • [40] Adaptive Multi-scale Cost Volume Construction and Aggregation for Stereo Matching
    Pang Y.-W.
    Su C.
    Long T.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2023, 44 (04): : 457 - 468