Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
|
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [21] Underwater Unsupervised Stereo Matching Method Based on Semantic Attention
    Li, Qing
    Wang, Hongjian
    Xiao, Yao
    Yang, Hualong
    Chi, Zhikang
    Dai, Dongchen
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (07)
  • [22] Unsupervised Domain Adaptation by Matching Distributions Based on the Maximum Mean Discrepancy via Unilateral Transformations
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4106 - 4113
  • [23] Adversarial Spectral Kernel Matching for Unsupervised Time Series Domain Adaptation
    Liu, Qiao
    Xue, Hui
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2744 - 2750
  • [24] Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision
    Bai, Gui-Rong
    Liu, Qing-Bin
    He, Shi-Zhu
    Liu, Kang
    Zhao, Jun
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2023, 38 (06) : 1237 - 1249
  • [25] Unsupervised SAR and Optical Image Matching Using Siamese Domain Adaptation
    Zhang, Zhaoxiang
    Xu, Yuelei
    Cui, Qi
    Zhou, Qing
    Ma, Linhua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision
    Gui-Rong Bai
    Qing-Bin Liu
    Shi-Zhu He
    Kang Liu
    Jun Zhao
    Journal of Computer Science and Technology, 2023, 38 : 1237 - 1249
  • [27] Unsupervised Domain Adaptation Using Robust Class-Wise Matching
    Zhang, Lei
    Wang, Peng
    Wei, Wei
    Lu, Hao
    Shen, Chunhua
    van den Hengel, Anton
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (05) : 1339 - 1349
  • [28] Biased transfer matching for less overlapping degree for unsupervised domain adaptation
    Wen, Yiran
    Cao, Xiu
    Wang, Xueping
    Liu, Fangyuan
    INTELLIGENT DATA ANALYSIS, 2020, 24 (02) : 409 - 425
  • [29] HoMM: Higher-Order Moment Matching for Unsupervised Domain Adaptation
    Chen, Chao
    Fu, Zhihang
    Chen, Zhihong
    Jin, Sheng
    Cheng, Zhaowei
    Jin, Xinyu
    Hua, Xian-Sheng
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3422 - 3429
  • [30] UNSUPERVISED DOMAIN ADAPTATION USING REGULARIZED HYPER-GRAPH MATCHING
    Das, Debasmit
    Lee, C. S. George
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3758 - 3762