Self-Supervised Learning for Specified Latent Representation

被引:4
|
作者
Liu, Chicheng [1 ,2 ]
Song, Libin [1 ,2 ]
Zhang, Jiwen [1 ,2 ]
Chen, Ken [1 ,2 ]
Xu, Jing [1 ,2 ]
机构
[1] Tsinghua Univ, State Key Lab Tribol, Beijing Key Lab Precis Ultra Precis Mfg Equipment, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Mech Engn, Beijing 100084, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Supervised learning; Shape; Semantics; Unsupervised learning; Encoding; Task analysis; Neural networks; Latent representation; neural networks; unsupervised learning; OBJECT DETECTION; REGRESSION;
D O I
10.1109/TFUZZ.2019.2904237
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current latent representation methods using unsupervised learning have no semantic meaning; thus, it is difficult to directly express their physical task in the real world. To this end, this paper attempts to propose a specified latent representation with physical semantic meaning. First, a few labeled samples are used to generate the framework of the latent space, and these labeled samples are mapped to framework nodes in the latent space. Second, a self-learning method using structured unlabeled samples is proposed to shape the free space between the framework nodes in the latent space. The proposed specified latent representation therefore possesses the advantages provided by both supervised and unsupervised learning. The proposed method is verified by numerical simulations and real-world experiments.
引用
收藏
页码:47 / 59
页数:13
相关论文
共 50 条
  • [21] Self-supervised Discriminative Representation Learning by Fuzzy Autoencoder
    Yang, Wenlu
    Wang, Hongjun
    Zhang, Yinghui
    Liu, Zehao
    Li, Tianrui
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (01)
  • [22] Video Face Clustering with Self-Supervised Representation Learning
    Sharma, Vivek
    Tapaswi, Makarand
    Saquib Sarfraz, M.
    Stiefelhagen, Rainer
    [J]. IEEE Transactions on Biometrics, Behavior, and Identity Science, 2020, 2 (02): : 145 - 157
  • [23] Self-Supervised Motion Perception for Spatiotemporal Representation Learning
    Liu, Chang
    Yao, Yuan
    Luo, Dezhao
    Zhou, Yu
    Ye, Qixiang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 9832 - 9846
  • [24] Self-supervised representation learning for SAR change detection
    Davis, Eric K.
    Houglund, Ian
    Franz, Douglas
    Allen, Michael
    [J]. ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXX, 2023, 12520
  • [25] Heuristic Attention Representation Learning for Self-Supervised Pretraining
    Van Nhiem Tran
    Liu, Shen-Hsuan
    Li, Yung-Hui
    Wang, Jia-Ching
    [J]. SENSORS, 2022, 22 (14)
  • [26] AtmoDist: Self-supervised representation learning for atmospheric dynamics
    Hoffmann, Sebastian
    Lessig, Christian
    [J]. ENVIRONMENTAL DATA SCIENCE, 2023, 2
  • [27] Self-Supervised Learning With Segmental Masking for Speech Representation
    Yue, Xianghu
    Lin, Jingru
    Gutierrez, Fabian Ritter
    Li, Haizhou
    [J]. IEEE Journal on Selected Topics in Signal Processing, 2022, 16 (06): : 1367 - 1379
  • [28] Randomly shuffled convolution for self-supervised representation learning
    Oh, Youngjin
    Jeon, Minkyu
    Ko, Dohwan
    Kim, Hyunwoo J.
    [J]. INFORMATION SCIENCES, 2023, 623 : 206 - 219
  • [29] Self-supervised representation learning for surgical activity recognition
    Paysan, Daniel
    Haug, Luis
    Bajka, Michael
    Oelhafen, Markus
    Buhmann, Joachim M.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (11) : 2037 - 2044
  • [30] CCBERT: Self-Supervised Code Change Representation Learning
    Zhou, Xin
    Xu, Bowen
    Han, DongGyun
    Yang, Zhou
    He, Junda
    Lo, David
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION, ICSME, 2023, : 182 - 193