Analysis of the efficacy and reliability of the Moodies app for detecting emotions through speech: Does it actually work?

被引:9
|
作者
Arana, Jose M. [1 ]
Gordillo, Fernando [2 ]
Darias, Jeannete [3 ]
Mestas, Lilia [4 ]
机构
[1] Univ Salamanca, Dept Psychol, Avda Merced 109-131, Salamanca 37005, Spain
[2] Univ Camilo Jose Cela, Dept Psychol, Castillo Alarcon 49, Madrid 28692, Spain
[3] Neurosci Inst Castilla & Leen, Commun Disorders, Calle Pintor Fernando Gallego 1, Salamanca 37007, Spain
[4] Univ Nacl Autonoma Mexico, Fac Estudios Super Zaragoza, Dept Psychol, C Batalla 5 Mayo S-N, Mexico City 09230, DF, Mexico
关键词
App; Emotions; LIWC; Moodies; Emotion recognition; Prosody; FACIAL EXPRESSIONS; VOICE; COMMUNICATION; AMYGDALA;
D O I
10.1016/j.chb.2019.106156
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Apps are software programs that enable users to optimise their resources in different areas. Recent years have seen a huge increase in the number of apps, whose use has spread in step with their perceived efficacy and reliability. This research focused on the Moodies app, designed for the voice detection of the speaker's emotions. Yet does it actually gauge emotions, and does it do so consistently over time? Our study therefore used this app to analyse the soundtracks of 34 scenes from different films in four languages, and the output Moodies provided was recorded in a brief text in English, which was processed using the tool Linguistic Inquiry and Word Count (LIWC). The same procedure was then repeated for a second measure. The analysis of the correspondence between the results obtained with Moodies and the interpretation made by LIWC considered the variables Emotion, prompted by scenes in films (disgust, happiness, anger, fear, tenderness, and sadness), Language (English, Spanish, Italian, and French), and the time of the measurement (Listening 1 and 2); an analysis was also conducted of reliability and concurrent criterion validity. The results show that Moodies correctly analyses emotions in dimensional terms (positive vs negative emotion), but not so in categorical terms, as it has difficulties in distinguishing between the emotions of anger and sadness and those of fear and disgust. In terms of reliability, there was a good correlation between listenings (r's Pearson correlation coefficient=.977), albeit with differences in the percentage of words detected (Listening 1 - Listening 2), which ranged between 0.00 and 22.06 (absolute value). It was also noted that language is not a significant variable, although it identifies a higher percentage of emotion words in scenes of fear in Spanish than in any other language. Based on these data as a whole, it may be concluded that Moodies classifies emotion in a more general way than expected and desired.
引用
收藏
页数:10
相关论文
共 22 条
  • [1] DETECTING STRESS AND DEPRESSION IN ADULTS WITH APHASIA THROUGH SPEECH ANALYSIS
    Gillespie, Stephanie
    Moore, Elliot
    Laures-Gore, Jacqueline
    Farina, Matthew
    Russell, Scott
    Logan, Yash-Yee
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 5140 - 5144
  • [2] Detecting fatigue in multiple sclerosis through automatic speech analysis
    Dias, Marcelo
    Doerr, Felix
    Garthof, Susett
    Schaefer, Simona
    Elmers, Julia
    Schwed, Louisa
    Linz, Nicklas
    Overell, James
    Hayward-Koennecke, Helen
    Troeger, Johannes
    Koenig, Alexandra
    Dillenseger, Anja
    Tackenberg, Bjoern
    Ziemssen, Tjalf
    FRONTIERS IN HUMAN NEUROSCIENCE, 2024, 18
  • [3] Detecting and rating dementia of Alzheimer type through lexical analysis of spontaneous speech
    Thomas, Calvin
    Kešelj, Vlado
    Cercone, Nick
    Rockwood, Kenneth
    Asp, Elissa
    Frontiers in Artificial Intelligence and Applications, 2013, 253 : 154 - 171
  • [4] Efficacy of Enalapril in Migraine Prophylaxis: Does It Work through Endothelial Dysfunction Recovery?
    Sonbolestan, Seyed Ali
    Heshmat, Kiyan
    Javanmard, Shaghayegh Haghjooy
    Saadatnia, Mohammad
    NEUROLOGY, 2010, 74 (09) : A574 - A574
  • [5] Does an open-plan office actually work? A workplace gap analysis: importance and perceived support of key activities
    Chacon Vega, Ricardo Jose
    Gale, Stephen P.
    Kim, Yujin
    Hong, Sungil
    Yang, Eunhwa
    JOURNAL OF CORPORATE REAL ESTATE, 2020, 22 (04) : 261 - 277
  • [6] Analysis of Emotions Through Speech Using the Combination of Multiple Input Sources with Deep Convolutional and LSTM Networks
    Morales, Cristyan R. Gil
    Shinde, Suraj
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, MICAI 2018, PT II, 2018, 11289 : 218 - 226
  • [7] Self-Efficacy, Emotions and Work Engagement Among Teachers: A Two Wave Cross-Lagged Analysis
    Irena Burić
    Ivana Macuka
    Journal of Happiness Studies, 2018, 19 : 1917 - 1933
  • [8] Self-Efficacy, Emotions and Work Engagement Among Teachers: A Two Wave Cross-Lagged Analysis
    Buric, Irena
    Macuka, Ivana
    JOURNAL OF HAPPINESS STUDIES, 2018, 19 (07) : 1917 - 1933
  • [9] SocialHaterBERT: A dichotomous approach for automatically detecting hate speech on Twitter through textual analysis and user profiles
    Del Valle-Cano, Gloria
    Quijano-Sanchez, Lara
    Liberatore, Federico
    Gomez, Jesus
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 216
  • [10] Assessing affective disorders through speech analysis: a self-assessment "voice app" for laptops, tablets, and smartphones
    Braun, S.
    Mohr, C.
    Moragrega, I.
    Papagno, C.
    Stassen, H. H.
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2016, 26 : S398 - S398