EmoChildRu: Emotional Child Russian Speech Corpus

被引:20
|
作者
Lyakso, Elena [1 ]
Frolova, Olga [1 ]
Dmitrieva, Evgeniya [1 ]
Grigorev, Aleksey [1 ]
Kaya, Heysem [2 ]
Salah, Albert Ali [2 ]
Karpov, Alexey [3 ,4 ]
机构
[1] St Petersburg State Univ, Child Speech Res Grp, St Petersburg 199034, Russia
[2] Bogazici Univ, Dept Comp Engn, Istanbul, Turkey
[3] RAS, St Petersburg Inst Informat & Automat, St Petersburg, Russia
[4] ITMO Univ, St Petersburg, Russia
来源
关键词
Emotional child speech; Perceptual analysis; Spectro-graphic analysis; Emotional states; Computational paralinguistics;
D O I
10.1007/978-3-319-23132-7_18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present the first child emotional speech corpus in Russian, called "EmoChildRu", which contains audio materials of 3-7 year old kids. The database includes over 20K recordings (approx. 30 h), collected from 100 children. Recordings were carried out in three controlled settings by creating different emotional states for children: playing with a standard set of toys; repetition of words from a toy-parrot in a game store setting; watching a cartoon and retelling of the story, respectively. This corpus is designed to study the reflection of the emotional state in the characteristics of voice and speech and for studies of the formation of emotional states in ontogenesis. A portion of the corpus is annotated for three emotional states (discomfort, neutral, comfort). Additional data include brain activity measurements (original EEG, evoked potentials records), the results of the adult listeners analysis of child speech, questionnaires, and description of dialogues. The paper reports two child emotional speech analysis experiments on the corpus: by adult listeners (humans) and by an automatic classifier (machine), respectively. Automatic classification results are very similar to human perception, although the accuracy is below 55% for both, showing the difficulty of child emotion recognition from speech under naturalistic conditions.
引用
收藏
页码:144 / 152
页数:9
相关论文
共 50 条
  • [31] Prosodic Processing for the Automatic Synthesis of Emotional Russian Speech
    Kaliyev, Arman
    Matveev, Yuri N.
    Lyakso, Elena E.
    Rybin, Sergey V.
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE QUALITY MANAGEMENT, TRANSPORT AND INFORMATION SECURITY, INFORMATION TECHNOLOGIES (IT&QM&IS), 2018, : 653 - 655
  • [32] Using a Serious Game to Collect a Child Learner Speech Corpus
    Baur, Claudia
    Rayner, Manny
    Tsourakis, Nikos
    [J]. LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, : 2726 - 2732
  • [33] Building A Naturalistic Emotional Speech Corpus by Retrieving Expressive Behaviors From Existing Speech Corpora
    Mariooryad, Soroosh
    Lotfian, Reza
    Busso, Carlos
    [J]. 15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4, 2014, : 238 - 242
  • [34] Emotional Intensity Estimation of a Japanese Speech Corpus Using Acoustic Features
    Kawase, Megumi
    Nakayama, Minoru
    [J]. 2021 25TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV): AI & VISUAL ANALYTICS & DATA SCIENCE, 2021, : 148 - 153
  • [35] Emotional Speech Recognition Using Rhythm Metrics and a New Arabic Corpus
    Meftah, Ali H.
    Qamhan, Mustafa
    Alotaibi, Yousef
    Selouani, Sid-Ahmed
    [J]. 2020 16TH IEEE INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA 2020), 2020, : 57 - 62
  • [36] PROTOCOL AND BASELINE FOR EXPERIMENTS ON BOGAZICI UNIVERSITY TURKISH EMOTIONAL SPEECH CORPUS
    Kaya, Heysem
    Salah, Albert Ali
    Gurgen, Sadik Fikret
    Ekenel, Hazim
    [J]. 2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 1698 - 1701
  • [37] JVNV: A Corpus of Japanese Emotional Speech With Verbal Content and Nonverbal Expressions
    Xin, Detai
    Jiang, Junfeng
    Takamichi, Shinnosuke
    Saito, Yuki
    Aizawa, Akiko
    Saruwatari, Hiroshi
    [J]. IEEE ACCESS, 2024, 12 : 19752 - 19764
  • [38] DESCU: Dyadic emotional speech corpus and recognition system for Urdu language
    Qasim, Muhammad
    Habib, Tania
    Urooj, Saba
    Mumtaz, Benazir
    [J]. SPEECH COMMUNICATION, 2023, 148 : 40 - 52
  • [39] An Open Source Emotional Speech Corpus for Human Robot Interaction Applications
    James, Jesin
    Tian, Li
    Watson, Catherine Inez
    [J]. 19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 2768 - 2772
  • [40] An Analysis of Malay Language Emotional Speech Corpus for Emotion Recognition System
    Apandi, Nurfarihah
    Jamil, Nursuriati
    [J]. 2016 IEEE INDUSTRIAL ELECTRONICS AND APPLICATIONS CONFERENCE (IEACON), 2016, : 225 - 231