Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
|
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [31] Unsupervised Cross-disease Domain Adaptation by Lesion Scale Matching
    Gao, Jun
    Lao, Qicheng
    Kang, Qingbo
    Liu, Paul
    Zhang, Le
    Li, Kang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VII, 2022, 13437 : 660 - 670
  • [32] Unsupervised Domain Adaptation Based on Correlation Maximization
    Abdi, Lida
    Hashemi, Sattar
    IEEE ACCESS, 2021, 9 : 127054 - 127067
  • [33] A Soft Sensor Method based on Unsupervised Multi-layer Domain Adaptation for Batch Processes
    Xiong, Qin
    Jin, Huaiping
    Bin Wang
    Liu, Haipeng
    Yu, Wangyang
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1805 - 1811
  • [34] Soft Labels Transfer with Discriminative Representations Learning for Unsupervised Domain Adaptation
    Cao, Manliang
    Zhou, Xiangdong
    Lin, Lan
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT III, 2021, 12459 : 515 - 530
  • [35] Stereo sample generation-based domain generalization network for stereo matching
    Xu, Liying
    Zhu, Jie
    Peng, Bo
    Liu, Bingzheng
    Zhang, Zhe
    Lei, Jianjun
    ELECTRONICS LETTERS, 2024, 60 (12)
  • [36] UNSUPERVISED STEREO MATCHING USING CORRESPONDENCE CONSISTENCY
    Joung, Sunghun
    Kim, Seungryong
    Ham, Bumsub
    Sohn, Kwanghoon
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2518 - 2522
  • [37] Randomized Histogram Matching: A Simple Augmentation for Unsupervised Domain Adaptation in Overhead Imagery
    Yaras, Can
    Kassaw, Kaleb
    Huang, Bohao
    Bradbury, Kyle
    Malof, Jordan M.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 1988 - 1998
  • [38] Unsupervised Domain Adaptation for Point Cloud Semantic Segmentation via Graph Matching
    Bian, Yikai
    Hui, Le
    Qian, Jianjun
    Xie, Jin
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 9899 - 9904
  • [39] Graph Matching and Pseudo-Label Guided Deep Unsupervised Domain Adaptation
    Das, Debasmit
    Lee, C. S. George
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT III, 2018, 11141 : 342 - 352
  • [40] Classifier Adaptation Based on Modified Label Propagation for Unsupervised Domain Adaptation
    Du, Yongjie
    Zhou, Deyun
    Xie, Yu
    Kong, Weiren
    Li, Xiaoyang
    Shi, Jiao
    Lei, Yu
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022