Multimodal sentiment analysis leveraging the strength of deep neural networks enhanced by the XGBoost classifier

被引:1
|
作者
Chandrasekaran, Ganesh [1 ]
Dhanasekaran, S. [2 ]
Moorthy, C. [3 ]
Oli, A. Arul [4 ]
机构
[1] Sri Eshwar Coll Engn, Dept Comp & Commun Engn, Coimbatore, Tamil Nadu, India
[2] Sri Eshwar Coll Engn, Dept Elect & Commun Engn, Coimbatore, Tamil Nadu, India
[3] Dr Mahalingam Coll Engn & Technol, Dept Elect & Commun Engn, Pollachi, Tamil Nadu, India
[4] Saveetha Engn Coll, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
关键词
Multimodal sentiment analysis; Mel-frequency cepstral coefficients (MFCC); convolutional neural networks (CNN); Hybrid LXGB Model; long short-term memory (LSTM); XGBoost classifiers;
D O I
10.1080/10255842.2024.2313066
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multimodal sentiment analysis, an increasingly vital task in the realms of natural language processing and machine learning, addresses the nuanced understanding of emotions and sentiments expressed across diverse data sources. This study presents the Hybrid LXGB (Long short-term memory Extreme Gradient Boosting) Model, a novel approach for multimodal sentiment analysis that merges the strengths of long short-term memory (LSTM) and XGBoost classifiers. The primary objective is to address the intricate task of understanding emotions across diverse data sources, such as textual data, images, and audio cues. By leveraging the capabilities of deep learning and gradient boosting, the Hybrid LXGB Model achieves an exceptional accuracy of 97.18% on the CMU-MOSEI dataset, surpassing alternative classifiers, including LSTM, CNN, DNN, and XGBoost. This study not only introduces an innovative model but also contributes to the field by showcasing its effectiveness and balance in capturing the nuanced spectrum of sentiments within multimodal datasets. The comparison with equivalent studies highlights the model's remarkable success, emphasizing its potential for practical applications in real-world scenarios. The Hybrid LXGB Model offers a unique and promising perspective in the realm of multimodal sentiment analysis, demonstrating the significance of integrating LSTM and XGBoost for enhanced performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Visual and Textual Sentiment Analysis of a Microblog Using Deep Convolutional Neural Networks
    Yu, Yuhai
    Lin, Hongfei
    Meng, Jiana
    Zhao, Zhehuan
    [J]. ALGORITHMS, 2016, 9 (02)
  • [42] Lexical Variation and Sentiment Analysis of Roman Urdu Sentences with Deep Neural Networks
    Manzoor, Muhammad Arslan
    Mamoon, Saqib
    Tao, Song Kei
    Zakir, Ali
    Adil, Muhammad
    Lu, Jianfeng
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (02) : 719 - 726
  • [43] Lexical variation and sentiment analysis of Roman Urdu sentences with deep neural networks
    Manzoor M.A.
    Mamoon S.
    Tao S.K.
    Zakir A.
    Adil M.
    Lu J.
    [J]. Lu, Jianfeng, 1600, Science and Information Organization : 719 - 726
  • [44] VISUAL AND TEXTUAL SENTIMENT ANALYSIS USING DEEP FUSION CONVOLUTIONAL NEURAL NETWORKS
    Chen, Xingyue
    Wang, Yunhong
    Liu, Qingjie
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1557 - 1561
  • [45] FeDN2: Fuzzy-Enhanced Deep Neural Networks for Improvement of Sentence-Level Sentiment Analysis
    Phan, Huyen Trang
    Pham, Dinh Tai
    Nguyen, Ngoc Thanh
    [J]. CYBERNETICS AND SYSTEMS, 2023,
  • [46] Multimodal detection of epilepsy with deep neural networks
    Ilias, Loukas
    Askounis, Dimitris
    Psarras, John
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [47] Neural Networks for Sentiment Analysis on Twitter
    Duncan, Brett
    Zhang, Yanqing
    [J]. PROCEEDINGS OF 2015 IEEE 14TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC), 2015, : 275 - 278
  • [48] SKEAFN: Sentiment Knowledge Enhanced Attention Fusion Network for multimodal sentiment analysis
    Zhu, Chuanbo
    Chen, Min
    Zhang, Sheng
    Sun, Chao
    Liang, Han
    Liu, Yifan
    Chen, Jincai
    [J]. INFORMATION FUSION, 2023, 100
  • [49] A Survey on Leveraging Deep Neural Networks for Object Tracking
    Krebs, Sebastian
    Duraisamy, Bharanidhar
    Flohr, Fabian
    [J]. 2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [50] Leveraging multimodal information for event summarization and concept-level sentiment analysis
    Shah, Rajiv Ratn
    Yu, Yi
    Verma, Akshay
    Tang, Suhua
    Shaikh, Anwar Dilawar
    Zimmermann, Roger
    [J]. KNOWLEDGE-BASED SYSTEMS, 2016, 108 : 102 - 109