AMPS: Predicting popularity of short-form videos using multi-modal attention mechanisms in social media marketing environments

被引:2
|
作者
Cho, Minhwa [1 ]
Jeong, Dahye [1 ]
Park, Eunil [1 ,2 ]
机构
[1] Sungkyunkwan Univ, Dept Appl Artificial Intelligence, Seoul, South Korea
[2] Sungkyunkwan Univ, 310 Int Hall,25-2 Sunkyunkwan Ro, Seoul 03063, South Korea
关键词
Social media; Popularity prediction; Multi-modal; Deep learning; Short-form content; Attention mechanism; SELF-ATTENTION;
D O I
10.1016/j.jretconser.2024.103778
中图分类号
F [经济];
学科分类号
02 ;
摘要
Emerging as a dominant content format amid the shift from television to mobile, short -form videos wield immense potential across diverse domains. However, the scarcity of datasets and established metrics for their popularity evaluation poses a challenge in accurately reflecting their real -world distribution. In response, our work introduces a dataset and pioneers a cumulative distribution function -based standard tailored specifically for short -form videos. Our model, AMPS (Attention -based Multi -modal Popularity prediction model of Short -form videos) is designed to effectively forecast the popularity of these videos. Considering YouTube Shorts, typically confined to under one minute, our research capitalizes on complete video frames for a holistic prediction of popularity. AMPS harnesses BiLSTM with Self -Attention and Co -Attention mechanisms, enabling a deeper understanding of intra-modal and inter -modal relationships across various modalities. Leveraging full video frame representation, our model significantly enhances prediction accuracy. Comprehensive evaluations against baseline models and machine learning algorithms consistently showcase AMPS' superiority in metrics like GMean, average F1 -score, and Accuracy. Furthermore, when compared with other open social media datasets, our dataset coupled with AMPS consistently outperforms, affirming its robustness and reliability. Additionally, ablation studies underscore the effectiveness of AMPS' architecture and highlight the significance of each modality in predicting popularity.
引用
收藏
页数:13
相关论文
共 23 条
  • [1] Social Media Popularity Prediction Based on Multi-Modal Self-Attention Mechanisms
    Lin, Hung-Hsiang
    Lin, Jiun-Da
    Ople, Jose Jaena Mari
    Chen, Jun-Cheng
    Hua, Kai-Lung
    [J]. IEEE ACCESS, 2022, 10 : 4448 - 4455
  • [2] Short-Form Videos as an Emerging Social Media Tool for STEM Edutainment
    Prindle, Claudia R.
    Orchanian, Nicholas M.
    Venkataraman, Latha
    Nuckolls, Colin
    [J]. JOURNAL OF CHEMICAL EDUCATION, 2024, 101 (03) : 1319 - 1324
  • [3] Popularity Prediction of Social Media based on Multi-Modal Feature Mining
    Hsu, Chih-Chung
    Kang, Li-Wei
    Lee, Chia-Yen
    Lee, Jun-Yi
    Zhang, Zhong-Xuan
    Wu, Shao-Min
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2687 - 2691
  • [4] User-guided Hierarchical Attention Network for Multi-modal Social Image Popularity Prediction
    Zhang, Wei
    Wang, Wen
    Wang, Jun
    Zha, Hongyuan
    [J]. WEB CONFERENCE 2018: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW2018), 2018, : 1277 - 1286
  • [5] Predicting image credibility in fake news over social media using multi-modal approach
    Bhuvanesh Singh
    Dilip Kumar Sharma
    [J]. Neural Computing and Applications, 2022, 34 : 21503 - 21517
  • [6] Predicting image credibility in fake news over social media using multi-modal approach
    Singh, Bhuvanesh
    Sharma, Dilip Kumar
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24): : 21503 - 21517
  • [7] Hierarchical graph attention networks for multi-modal rumor detection on social media
    Xu, Fan
    Zeng, Lei
    Huang, Qi
    Yan, Keyu
    Wang, Mingwen
    Sheng, Victor S.
    [J]. NEUROCOMPUTING, 2024, 569
  • [8] An attention based multi-modal gender identification system for social media users
    Chanchal Suman
    Rohit Shyamkant Chaudhary
    Sriparna Saha
    Pushpak Bhattacharyya
    [J]. Multimedia Tools and Applications, 2022, 81 : 27033 - 27055
  • [9] An attention based multi-modal gender identification system for social media users
    Suman, Chanchal
    Chaudhary, Rohit Shyamkant
    Saha, Sriparna
    Bhattacharyya, Pushpak
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (19) : 27033 - 27055
  • [10] Multi-Modal fake news Detection on Social Media with Dual Attention Fusion Networks
    Yang, Haitian
    Zhao, Xuan
    Sun, Degang
    Wang, Yan
    Zhu, He
    Ma, Chao
    Huang, Weiqing
    [J]. 26TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2021), 2021,