Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
|
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [41] Planet Craters Detection Based on Unsupervised Domain Adaptation
    Zhang, Zhaoxiang
    Xu, Yuelei
    Song, Jianing
    Zhou, Qing
    Rasol, Jarhinbek
    Ma, Linhua
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (05) : 7140 - 7152
  • [42] Sea fog detection based on unsupervised domain adaptation
    Mengqiu XU
    Ming WU
    Jun GUO
    Chuang ZHANG
    Yubo WANG
    Zhanyu MA
    Chinese Journal of Aeronautics, 2022, 35 (04) : 415 - 425
  • [43] Soft Sensor Development Based on Unsupervised Dynamic Weighted Domain Adaptation for Quality Prediction of Batch Processes
    Jin, Huaiping
    Xiong, Qin
    Wang, Bin
    Qian, Bin
    Yang, Biao
    Dong, Shoulong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 1
  • [44] Unsupervised sleep staging system based on domain adaptation
    Zhao, Ranqi
    Xia, Yi
    Zhang, Yongliang
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 69 (69)
  • [45] Dynamic-graph-based Unsupervised Domain Adaptation
    Du, Yongjie
    Zhou, Deyun
    Shi, Jiao
    Lei, Yu
    Gong, Maoguo
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [46] Sea fog detection based on unsupervised domain adaptation
    Mengqiu XU
    Ming WU
    Jun GUO
    Chuang ZHANG
    Yubo WANG
    Zhanyu MA
    Chinese Journal of Aeronautics , 2022, (04) : 415 - 425
  • [47] Sea fog detection based on unsupervised domain adaptation
    Xu, Mengqiu
    Wu, Ming
    Guo, Jun
    Zhang, Chuang
    Wang, Yubo
    Ma, Zhanyu
    CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (04) : 415 - 425
  • [48] Diagnosis of atrial fibrillation based on unsupervised domain adaptation
    Du, Mingyu
    Yang, Yuan
    Zhang, Lin
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 164
  • [49] Unsupervised domain adaptation based on the predictive uncertainty of models
    Lee, JoonHo
    Lee, Gyemin
    NEUROCOMPUTING, 2023, 520 : 183 - 193
  • [50] Uncertainty Guided Adaptive Warping for Robust and Efficient Stereo Matching
    Jing, Junpeng
    Li, Jiankun
    Xiong, Pengfei
    Liu, Jiangyu
    Liu, Shuaicheng
    Guo, Yichen
    Deng, Xin
    Xu, Mai
    Jiang, Lai
    Sigal, Leonid
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3295 - 3304