An AI-Based Feedback Visualisation System for Speech Training

被引：0

作者：

Wynn, Adam T. ^{[1
]}

Wang, Jingyun ^{[1
]}

Umezawa, Kaoru ^{[1
]}

Cristea, Alexandra, I ^{[1
]}

机构：

[1] Univ Durham, Durham DH1 3LE, England

来源：

ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS AND DOCTORAL CONSORTIUM, PT II | 2022年 / 13356卷

关键词：

CNN; Automatic visualisation feedback; Second language speech training; Emotion recognition; Speech prosody;

D O I：

10.1007/978-3-031-11647-6_104

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper proposes providing automatic feedback to support public speech training. For the first time, speech feedback is provided on a visual dashboard including not only the transcription and pitch information, but also emotion information. A method is proposed to perform emotion classification using state-of-the-art convolutional neural networks (CNNs). Moreover, this approach can be used for speech analysis purposes. A case study exploring pitch in Japanese speech is presented in this paper.

引用

页码：510 / 514

页数：5

共 50 条

[1] AI-based Arabic Language and Speech Tutor
Shao, Sicong
Alharir, Saleem
Hariri, Salim
Satam, Pratik
Shiri, Sonia
Mbarki, Abdessamad
[J]. 2022 IEEE/ACS 19TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2022,
[2] Designing AI-Based Feedback for Ballet Learning
Trajkova, Milka
[J]. CHI'20: EXTENDED ABSTRACTS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2020,
[3] A DOMAIN-INDEPENDENT STUDENT MODEL FOR AN AI-BASED TRAINING SYSTEM
FRENCH, PD
[J]. COMPUTERS & EDUCATION, 1990, 15 (1-3) : 49 - 61
[4] An explanation framework and method for AI-based text emotion analysis and visualisation
Li, Yuming
Chan, Johnny
Peko, Gabrielle
Sundaram, David
[J]. DECISION SUPPORT SYSTEMS, 2024, 178
[5] AI-based assessments of speech and language impairments in dementia
Parsapoor, Mahboobeh
[J]. ALZHEIMERS & DEMENTIA, 2023, 19 (10) : 4675 - 4687
[6] AI-Based Assistance System for Manufacturing
Deppe, Sahar
Brandt, Lukas
Bruenninghaus, Marc
Papenkordt, Jorg
Heindorf, Stefan
Tschirner-Vinke, Gudrun
[J]. 2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
[7] AI-Based Health Management System
Nagulpelli, Swadhin
Chavan, Akash
Kandalkar, Aniket
Kulkarni, Smita
[J]. INTELLIGENT SYSTEMS AND APPLICATIONS, ICISA 2022, 2023, 959 : 379 - 389
[8] TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM
Jho, Hunkoog
Ha, Minsu
[J]. JOURNAL OF BALTIC SCIENCE EDUCATION, 2024, 23 (02): : 280 - 291
[9] A systematic review of AI-based automated written feedback research
Shi, Huawei
Aryadoust, Vahid
[J]. RECALL, 2024, 36 (02) : 187 - 209
[10] Conversational AI-based VR system to improve construction safety training of migrant workers
Hussain, Rahat
Sabir, Aqsa
Lee, Do-Yeop
Zaidi, Syed Farhan Alam
Pedro, Akeem
Abbas, Muhammad Sibtain
Park, Chansik
[J]. AUTOMATION IN CONSTRUCTION, 2024, 160

← 1 2 3 4 5 →