Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
|
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [1] Geometry-Aware Unsupervised Domain Adaptation for Stereo Matching
    Sakuma, Hiroki
    Konishi, Yoshinori
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 6116 - 6123
  • [2] Edge Domain Adaptation for Stereo Matching
    Li, Xing
    Fan, Yangyu
    Guo, Zhe
    Duan, Yu
    Liu, Shiya
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (07): : 2970 - 2980
  • [3] Warping-based spectral translation network for unsupervised cross-spectral stereo matching
    Chang, Yong-Jun
    Lee, Byung-Geun
    Jeon, Moongu
    INFORMATION SCIENCES, 2022, 588 : 214 - 230
  • [4] Horizontal Attention Based Generation Module for Unsupervised Domain Adaptive Stereo Matching
    Wang, Sungjun
    Seo, Junghyun
    Jeon, Hyunjae
    Lim, Sungjin
    Park, Sanghyun
    Lim, Yongseob
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6779 - 6786
  • [5] Transfer Joint Matching for Unsupervised Domain Adaptation
    Long, Mingsheng
    Wang, Jianmin
    Ding, Guiguang
    Sun, Jiaguang
    Yu, Philip S.
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1410 - 1417
  • [6] Unsupervised Domain Adaptation with Distribution Matching Machines
    Cao, Yue
    Long, Mingsheng
    Wang, Jianmin
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 2795 - 2802
  • [7] Discriminative Joint Matching for Unsupervised Domain Adaptation
    Zhang Y.
    Xia T.
    Huang D.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (10): : 932 - 940
  • [8] Bayesian Uncertainty Matching for Unsupervised Domain Adaptation
    Wen, Jun
    Zheng, Nenggan
    Yuan, Junsong
    Gong, Zhefeng
    Chen, Changyou
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3849 - 3855
  • [9] Correlated Matching and Structure Learning for Unsupervised Domain Adaptation
    Luo, Xingping
    Lu, Yuwu
    Wen, Jiajun
    Lai, Zhihui
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 67 - 80
  • [10] Moment matching of joint distributions for unsupervised domain adaptation
    Zhang, Bo
    Zhang, Xiaoming
    Zhou, Zhibo
    Liu, Yun
    Li, Yancong
    Huang, Feiran
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (01)