Deep low-rank matrix factorization with latent correlation estimation for micro-video multi-label classification

被引:10
|
作者
Su, Yuting [1 ]
Xu, Junyu [2 ]
Hong, Daozheng [1 ]
Fan, Fugui [1 ]
Zhang, Jing [1 ]
Jing, Peiguang [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] China Elect Technol Grp Corp, Res Inst 28, Nanjing 210007, Peoples R China
关键词
Deep matrix factorization; Micro-video; Multi-label learning; Label correlation; Low-rank constraint; OBJECTS; IMAGE;
D O I
10.1016/j.ins.2021.07.021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, micro-videos are becoming an increasingly prevailing form of user-generated contents (UGCs) on various social platforms. Several studies have been conducted to explore the semantics of micro-videos and the behavior of individuals for various tasks, such as venue categorization, popularity prediction, and personalized recommendation. However, few studies have been dedicated to solving micro-video multi-label classification. More importantly, learning intrinsic and robust feature representations for micro videos is still a complicated and challenging problem. In this paper, we propose a deep matrix factorization with latent correlation estimation (DMFLCE) for micro-video multi label classification. In DMFLCE, we develop a deep matrix factorization component constrained by a low-rank constraint to learn the lowest-rank representations for micro videos and the intrinsic characterizations for latent attributes simultaneously. To explicitly exhibit the dependencies of the learned latent attributes and labels for improved classification performance, we construct two inverse covariance estimation components to automatically encode correlation patterns with respect to the latent attributes and labels. Experiments conducted on a publicly available large-scale micro-video dataset demonstrate the effectiveness of our proposed method compared with state-of-the-art methods. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:587 / 598
页数:12
相关论文
共 50 条
  • [41] Learning and Compressing: Low-Rank Matrix Factorization for Deep Neural Network Compression
    Cai, Gaoyuan
    Li, Juhu
    Liu, Xuanxin
    Chen, Zhibo
    Zhang, Haiyan
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [42] Multi-Label Classification Based on Low Rank Representation for Image Annotation
    Tan, Qiaoyu
    Liu, Yezi
    Chen, Xia
    Yu, Guoxian
    REMOTE SENSING, 2017, 9 (02)
  • [43] Semi-Orthogonal Low-Rank Matrix Factorization for Deep Neural Networks
    Povey, Daniel
    Cheng, Gaofeng
    Wang, Yiming
    Li, Ke
    Xu, Hainan
    Yarmohamadi, Mahsa
    Khudanpur, Sanjeev
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3743 - 3747
  • [44] A Label-Correlated Multi-label Classification Algorithm Based on Spearman Rank Correlation Coefficient
    Li, Zhiqiang
    Wang, Shihui
    Guo, Hongchen
    RECENT DEVELOPMENTS IN INTELLIGENT SYSTEMS AND INTERACTIVE APPLICATIONS (IISA2016), 2017, 541 : 51 - 58
  • [45] Deep Large-Margin Rank Loss for Multi-Label Image Classification
    Ma, Zhongchen
    Li, Zongpeng
    Zhan, Yongzhao
    MATHEMATICS, 2022, 10 (23)
  • [46] Graph Regularized Low-Rank Feature Learning for Robust Multi-Label Image Annotation
    Li, Jingwei
    Feng, Songhe
    Lang, Congyan
    PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 102 - 106
  • [47] Robust Semi-supervised Multi-label Learning by Triple Low-Rank Regularization
    Sun, Lijuan
    Feng, Songhe
    Lyu, Gengyu
    Lang, Congyan
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT II, 2019, 11440 : 269 - 280
  • [48] EXTRACTING DEEP NEURAL NETWORK BOTTLENECK FEATURES USING LOW-RANK MATRIX FACTORIZATION
    Zhang, Yu
    Chuangsuwanich, Ekapol
    Glass, James
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [49] Cluster structure augmented deep nonnegative matrix factorization with low-rank tensor learning
    Zhong, Bo
    Wu, Jian-Sheng
    Huang, Wei
    Zheng, Wei-Shi
    INFORMATION SCIENCES, 2024, 670
  • [50] Video Deraining and Desnowing Using Temporal Correlation and Low-Rank Matrix Completion
    Kim, Jin-Hwan
    Sim, Jae-Young
    Kim, Chang-Su
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (09) : 2658 - 2670