UCoL: Unsupervised Learning of Discriminative Facial Representations via Uncertainty-Aware Contrast

被引:0
|
作者
Wang, Hao [1 ]
Li, Min [1 ]
Song, Yangyang [1 ]
Zhang, Youjian [2 ]
Chi, Liying [1 ]
机构
[1] ByteDance Inc, Beijing, Peoples R China
[2] Univ Sydney, Sydney, NSW, Australia
关键词
FACES;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents Uncertainty-aware Contrastive Learning (UCoL): a fully unsupervised framework for discriminative facial representation learning. Our UCoL is built upon a momentum contrastive network, referred to as Dual-path Momentum Network. Specifically, two flows of pairwise contrastive training are conducted simultaneously: one is formed with intra-instance self augmentation, and the other is to identify positive pairs collected by online pairwise prediction. We introduce a novel uncertainty-aware consistency K-nearest neighbors algorithm to generate predicted positive pairs, which enables efficient discriminative learning from large-scale open-world unlabeled data. Experiments show that UCoL significantly improves the baselines of unsupervised models and performs on par with the semi-supervised and supervised face representation learning methods.
引用
收藏
页码:2510 / 2518
页数:9
相关论文
共 50 条
  • [21] Unsupervised Domain Adaptive Salient Object Detection through Uncertainty-Aware Pseudo-Label Learning
    Yan, Pengxiang
    Wu, Ziyi
    Liu, Mengmeng
    Zeng, Kun
    Lin, Liang
    Li, Guanbin
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3000 - 3008
  • [22] Robust Tracking via Uncertainty-Aware Semantic Consistency
    Ma, Jie
    Lan, Xiangyuan
    Zhong, Bineng
    Li, Guorong
    Tang, Zhenjun
    Li, Xianxian
    Ji, Rongrong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1740 - 1751
  • [23] NPCL: Neural Processes for Uncertainty-Aware Continual Learning
    Jha, Saurav
    Gong, Dong
    Zhao, He
    Yao, Lina
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [24] Uncertainty-Aware Deep Learning Based Deformable Registration
    Grigorescu, Irina
    Uus, Alena
    Christiaens, Daan
    Cordero-Grande, Lucilio
    Hutter, Jana
    Batalle, Dafnis
    Edwards, A. David
    Hajnal, Joseph V.
    Modat, Marc
    Deprez, Maria
    UNCERTAINTY FOR SAFE UTILIZATION OF MACHINE LEARNING IN MEDICAL IMAGING, AND PERINATAL IMAGING, PLACENTAL AND PRETERM IMAGE ANALYSIS, 2021, 12959 : 54 - 63
  • [25] Uncertainty-Aware Prognosis via Deep Gaussian Process
    Biggio, Luca
    Wieland, Alexander
    Chao, Manuel Arias
    Kastanis, Iason
    Fink, Olga
    IEEE ACCESS, 2021, 9 : 123517 - 123527
  • [26] Uncertainty-aware machine learning for high energy physics
    Ghosh, Aishik
    Nachman, Benjamin
    Whiteson, Daniel
    PHYSICAL REVIEW D, 2021, 104 (05)
  • [27] Training Uncertainty-Aware Classifiers with Conformalized Deep Learning
    Einbinder, Bat-Sheva
    Romano, Yaniv
    Sesia, Matteo
    Zhou, Yanfei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [28] Uncertainty-Aware Data Aggregation for Deep Imitation Learning
    Cui, Yuchen
    Isele, David
    Niekum, Scott
    Fujimura, Kikuo
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 761 - 767
  • [29] Uncertainty-Aware Health Diagnostics via Class-Balanced Evidential Deep Learning
    Xia, Tong
    Dang, Ting
    Han, Jing
    Qendro, Lorena
    Mascolo, Cecilia
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (11) : 6417 - 6428
  • [30] Learning an Uncertainty-Aware Object Detector for Autonomous Driving
    Meyer, Gregory P.
    Thakurdesai, Niranjan
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10521 - 10527