Psychological disorder detection: A multimodal approach using a transformer-based hybrid model

被引:0
|
作者
Ghosh, Debadrita [2 ]
Karande, Hema [1 ,2 ]
Gite, Shilpa [1 ,2 ]
Pradhan, Biswajeet [3 ]
机构
[1] Symbiosis Int Univ, Symbiosis Ctr Appl AI SCAAI, Pune 412115, India
[2] Symbiosis Int Univ, Symbiosis Inst Technol, Artificial Intelligence & Machine Learning Dept, Pune 412115, India
[3] Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Adv Modelling & Geospatial Informat Syst CAMGI, Sch Civil & Environm Engn, Sydney, Australia
关键词
Psychological distress; Depression; Mental disorder; Deep learning; MENTAL-DISORDER;
D O I
10.1016/j.mex.2024.102976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
developed a Detecting psychological disorders, particularly depression, is a complex and critical task within the realm of mental health assessment. This research explores a novel approach to improve the identification of psychological distresses, such as depression, by addressing the subjectivity, complexity, and biasness inherent in traditional diagnostic techniques. Using multimodal data, such as voice characteristics and linguistic content from participant interviews, Transformer-Based Hybrid Model that combines advanced natural language processing and deep learning approaches. This model provides a complete assessment of an individual's psycholog ical well-being by merging aural cues and textual data. This study investigates the theoretical underpinnings, technical complexities, and practical applications of this model in the context of psychological disorder detection. Additionally, the model's design and implementation details are thoroughly documented to ensure replicability by other researchers. A unique way of strengthening emotional ailments (focusing on depression). Transformer-Based Hybrid Model is proposed using multimodal data from interviews of par ticipants. The model integrates voice characteristics (aural cues) and linguistic content (textual data). Comparative analysis of this research with existing approaches.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Transformer-based models for multimodal irony detection
    Tomás D.
    Ortega-Bueno R.
    Zhang G.
    Rosso P.
    Schifanella R.
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (6) : 7399 - 7410
  • [2] A Hybrid Transformer-Based Model for Optimizing Fake News Detection
    Al-Quayed, Fatima
    Javed, Danish
    Jhanjhi, N.Z.
    Humayun, Mamoona
    Alnusairi, Thanaa S.
    [J]. IEEE Access, 2024, 12 : 160822 - 160834
  • [3] Transformer-Based Approach to Melanoma Detection
    Cirrincione, Giansalvo
    Cannata, Sergio
    Cicceri, Giovanni
    Prinzi, Francesco
    Currieri, Tiziana
    Lovino, Marta
    Militello, Carmelo
    Pasero, Eros
    Vitabile, Salvatore
    [J]. SENSORS, 2023, 23 (12)
  • [4] HTDet: A Hybrid Transformer-Based Approach for Underwater Small Object Detection
    Chen, Gangqi
    Mao, Zhaoyong
    Wang, Kai
    Shen, Junge
    [J]. REMOTE SENSING, 2023, 15 (04)
  • [5] Multimodal Fake News Detection on Fakeddit Dataset Using Transformer-Based Architectures
    Kalra, Sakshi
    Kumar, Chitneedi Hemanth Sai
    Sharma, Yashvardhan
    Chauhan, Gajendra Singh
    [J]. Communications in Computer and Information Science, 2022, 1763 CCIS : 281 - 292
  • [6] Multimodal Depression Detection Using Task-oriented Transformer-based Embedding
    Rasipuram, Sowmya
    Bhat, Junaid Hamid
    Maitra, Anutosh
    Shaw, Bishal
    Saha, Sriparna
    [J]. 2022 27TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2022), 2022,
  • [7] Multimodal Fake News Detection on Fakeddit Dataset Using Transformer-Based Architectures
    Kalra, Sakshi
    Kumar, Chitneedi Hemanth Sai
    Sharma, Yashvardhan
    Chauhan, Gajendra Singh
    [J]. MACHINE LEARNING, IMAGE PROCESSING, NETWORK SECURITY AND DATA SCIENCES, MIND 2022, PT II, 2022, 1763 : 281 - 292
  • [8] Transformer-based Approaches for Personality Detection using the MBTI Model
    Lazo Vasquez, Ricardo
    Ochoa-Luna, Jose
    [J]. 2021 XLVII LATIN AMERICAN COMPUTING CONFERENCE (CLEI 2021), 2021,
  • [9] Transformer-based multimodal change detection with multitask consistency constraints
    Liu, Biyuan
    Chen, Huaixin
    Li, Kun
    Yang, Michael Ying
    [J]. Information Fusion, 2024, 108
  • [10] A transformer-based approach to irony and sarcasm detection
    Rolandos Alexandros Potamias
    Georgios Siolas
    Andreas - Georgios Stafylopatis
    [J]. Neural Computing and Applications, 2020, 32 : 17309 - 17320