Learning Domain Invariant Features for Unsupervised Indoor Depth Estimation Adaptation

被引:0
|
作者
Zhang, Jiehua [1 ]
Li, Liang [2 ]
Yan, Chenggang [3 ]
Wang, Zhan [4 ]
Xu, Changliang [5 ,6 ]
Zhang, Jiyong [3 ]
Chen, Chuqiao [7 ]
机构
[1] Xi An Jiao Tong Univ, Xian, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
[3] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[4] Moreal Pte Ltd, Singapore, Singapore
[5] State Key Lab Media Convergence Prod Technol Syst, Beijing, Peoples R China
[6] Xinhua Zhiyun Technol Co Ltd, Beijing, Peoples R China
[7] Hangzhou Dianzi Univ, Lishui Inst, Hangzhou, Peoples R China
关键词
Indoor depth estimation; unsupervised learning; transfer learning; domain adaptation;
D O I
10.1145/3672397
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predicting depth maps from monocular images has made an impressive performance in the past years. However, most depth estimation methods are trained with paired image-depth map data or multi-view images (e.g., stereo pair and monocular sequence), which suffer from expensive annotation costs and poor transferability. Although unsupervised domain adaptation methods are introduced to mitigate the reliance on annotated data, rare works focus on the unsupervised cross-scenario indoor monocular depth estimation. In this article, we propose to study the generalization of depth estimation models across different indoor scenarios in an adversarial-based domain adaptation paradigm. Concretely, a domain discriminator is designed for discriminating the representation from source and target domains, while the feature extractor aims to confuse the domain discriminator by capturing domain-invariant features. Further, we reconstruct depth maps from latent representations with the supervision of labeled source data. As a result, the feature extractor learned features possess the merit of both domain-invariant and low source risk, and the depth estimator can deal with the domain shift between source and target domains. We conduct the cross-scenario and cross-dataset experiments on the ScanNet and NYU-Depth-v2 datasets to verify the effectiveness of our method and achieve impressive performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Transfer metric learning for unsupervised domain adaptation
    Huang, Junchu
    Zhou, Zhiheng
    IET IMAGE PROCESSING, 2019, 13 (05) : 804 - 810
  • [42] Learning Transferrable Representations for Unsupervised Domain Adaptation
    Sener, Ozan
    Song, Hyun Oh
    Saxena, Ashutosh
    Savarese, Silvio
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [43] Adversarial Reinforcement Learning for Unsupervised Domain Adaptation
    Zhang, Youshan
    Ye, Hui
    Davison, Brian D.
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 635 - 644
  • [44] FINDING ROBUST TRANSFER FEATURES FOR UNSUPERVISED DOMAIN ADAPTATION
    Gao, Depeng
    Wu, Rui
    Liu, Jiafeng
    Fan, Xiaopeng
    Tang, Xianglong
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2020, 30 (01) : 99 - 112
  • [45] Monocular Depth Estimation Based on Unsupervised Learning
    Liu, Wan
    Sun, Yan
    Wang, XuCheng
    Yang, Lin
    Zheng, Zhenrong
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [46] Unsupervised Domain Adaptation of Deep Networks for ToF Depth Refinement
    Agresti, Gianluca
    Schaefer, Henrik
    Sartor, Piergiorgio
    Incesu, Yalcin
    Zanuttigh, Pietro
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 9195 - 9208
  • [47] Unsupervised Domain Adaptation for Semantic Segmentation using Depth Distribution
    Wu, Quanliang
    Liu, Huajun
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [48] Attribute-Aligned Domain-Invariant Feature Learning for Unsupervised Domain Adaptation Person Re-Identification
    Li, Huafeng
    Chen, Yiwen
    Tao, Dapeng
    Yu, Zhengtao
    Qi, Guanqiu
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 1480 - 1494
  • [49] Learning emotion-discriminative and domain-invariant features for domain adaptation in speech emotion recognition
    Mao, Qirong
    Xu, Guopeng
    Xue, Wentao
    Gou, Jianping
    Zhan, Yongzhao
    SPEECH COMMUNICATION, 2017, 93 : 1 - 10
  • [50] Cross-Domain Contrastive Learning for Unsupervised Domain Adaptation
    Wang, Rui
    Wu, Zuxuan
    Weng, Zejia
    Chen, Jingjing
    Qi, Guo-Jun
    Jiang, Yu-Gang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1665 - 1673