Deep low-rank matrix factorization with latent correlation estimation for micro-video multi-label classification

被引:10
|
作者
Su, Yuting [1 ]
Xu, Junyu [2 ]
Hong, Daozheng [1 ]
Fan, Fugui [1 ]
Zhang, Jing [1 ]
Jing, Peiguang [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] China Elect Technol Grp Corp, Res Inst 28, Nanjing 210007, Peoples R China
关键词
Deep matrix factorization; Micro-video; Multi-label learning; Label correlation; Low-rank constraint; OBJECTS; IMAGE;
D O I
10.1016/j.ins.2021.07.021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, micro-videos are becoming an increasingly prevailing form of user-generated contents (UGCs) on various social platforms. Several studies have been conducted to explore the semantics of micro-videos and the behavior of individuals for various tasks, such as venue categorization, popularity prediction, and personalized recommendation. However, few studies have been dedicated to solving micro-video multi-label classification. More importantly, learning intrinsic and robust feature representations for micro videos is still a complicated and challenging problem. In this paper, we propose a deep matrix factorization with latent correlation estimation (DMFLCE) for micro-video multi label classification. In DMFLCE, we develop a deep matrix factorization component constrained by a low-rank constraint to learn the lowest-rank representations for micro videos and the intrinsic characterizations for latent attributes simultaneously. To explicitly exhibit the dependencies of the learned latent attributes and labels for improved classification performance, we construct two inverse covariance estimation components to automatically encode correlation patterns with respect to the latent attributes and labels. Experiments conducted on a publicly available large-scale micro-video dataset demonstrate the effectiveness of our proposed method compared with state-of-the-art methods. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:587 / 598
页数:12
相关论文
共 50 条
  • [1] Low-Rank Regularized Deep Collaborative Matrix Factorization for Micro-Video Multi-Label Classification
    Su, Yuting
    Hong, Daozheng
    Li, Yang
    Jing, Peiguang
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 740 - 744
  • [2] A deep low-rank semantic factorization method for micro-video multi-label classification
    Fan, Fugui
    Su, Yuting
    Liu, Yun
    Jing, Peiguang
    Qu, Kaihua
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [3] Learning Dual Low-Rank Representation for Multi-Label Micro-Video Classification
    Lu, Wei
    Li, Desheng
    Nie, Liqiang
    Jing, Peiguang
    Su, Yuting
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 77 - 89
  • [4] Deep Matrix Factorization With Complementary Semantic Aggregation for Micro-Video Multi-Label Classification
    Jing, Peiguang
    Liu, Xiaoyu
    Wang, Xuehui
    Su, Yuting
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1685 - 1689
  • [5] SADCMF: Self-Attentive Deep Consistent Matrix Factorization for Micro-Video Multi-Label Classification
    Fan F.
    Jing P.
    Nie L.
    Gu H.
    Su Y.
    IEEE Transactions on Multimedia, 2024, 26 : 1 - 11
  • [6] Multimodal deep hierarchical semantic-aligned matrix factorization method for micro-video multi-label classification
    Fan, Fugui
    Su, Yuting
    Liu, Yun
    Jing, Peiguang
    Qu, Kaihua
    Liu, Yu
    INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (05)
  • [7] Dual-Domain Aligned Deep Hierarchical Matrix Factorization Method for Micro-Video Multi-Label Classification
    Fan, Fugui
    Su, Yuting
    Nie, Liqiang
    Jing, Peiguang
    Hong, Daozheng
    Liu, Yu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2598 - 2607
  • [8] Research on Micro-video Multi-Label Classification Based on Deep Multimodal Association Learning
    Li, Yun
    Lu, Zhixiang
    Liu, Shuyi
    Wang, Su
    Lü, Zimin
    Jing, Peiguang
    Data Analysis and Knowledge Discovery, 2024, 8 (07) : 77 - 88
  • [9] Multimodal Attentive Representation Learning for Micro-video Multi-label Classification
    Jing, Peiguang
    Liu, Xianyi
    Zhang, Lijuan
    Li, Yun
    Liu, Yu
    Su, Yuting
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (06)
  • [10] Sparse and low-rank representation for multi-label classification
    He, Zhi-Fen
    Yang, Ming
    APPLIED INTELLIGENCE, 2019, 49 (05) : 1708 - 1723