Opti-Speech: A real-time, 3D visual feedback system for speech training

被引：0

作者：

Katz, William ^{[1
]}

Campbell, Thomas ^{[1
]}

Wang, Jun ^{[1
,2
]}

Farrar, Eric ^{[3
]}

Eubanks, J. Coleman ^{[3
]}

Balasubramanian, Arvind ^{[4
]}

Prabhakaran, Balakrishnan ^{[4
]}

Rennaker, Rob ^{[2
,5
]}

机构：

[1] Univ Texas Dallas, Callier Ctr Commun Disorders, Dallas, TX USA

[2] Univ Texas Dallas, Dept Bioengn, Dallas, TX USA

[3] Univ Texas Dallas, Arts & Technol Program, Dallas, TX USA

[4] Univ Texas Dallas, Dept Comp Sci, Dallas, TX USA

[5] Vulintus LLC, Sachse, TX USA

来源：

15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4 | 2014年

关键词：

speech production; visual feedback; speech therapy; electromagnetic articulography; APRAXIA;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We describe an interactive 3D system to provide talkers with real-time information concerning their tongue and jaw movements during speech. Speech movement is tracked by a magnetometer system (Wave; NDI, Waterloo, Ontario, Canada). A customized interface allows users to view their current tongue position (represented as an avatar consisting of flesh-point markers and a modeled surface) placed in a synchronously moving, transparent head. Subjects receive augmented visual feedback when tongue sensors achieve the correct place of articulation. Preliminary data obtained for a group of adult talkers suggest this system can be used to reliably provide real-time feedback for American English consonant place of articulation targets. Future studies, including tests with communication disordered subjects, are described.

引用

页码：1174 / 1178

页数：5

共 50 条

[1] Real-time speech synthesis system driven by visual speech
Li, G
Xie, GM
Lin, L
[J]. PROCEEDINGS OF THE THIRD INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION SCIENCE AND TECHNOLOGY, VOL 2, 2004, : 397 - 402
[2] Improved 3D real-time MRI of speech production
Zhao, Ziwei
Lim, Yongwan
Byrd, Dani
Narayanan, Shrikanth
Nayak, Krishna S.
[J]. MAGNETIC RESONANCE IN MEDICINE, 2021, 85 (06) : 3182 - 3195
[3] Real-time speech-driven 3D face animation
Hong, PY
Wen, Z
Huang, TS
Shum, HY
[J]. FIRST INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING VISUALIZATION AND TRANSMISSION, 2002, : 713 - 716
[4] REAL-TIME AREAGRAPH OF CONTINUOUS SPEECH FOR ANALYSIS AND SPEECH TRAINING
FALLSIDE, F
BROOKS, S
[J]. ELECTRONICS LETTERS, 1976, 12 (20) : 515 - 516
[5] REAL-TIME SPEECH SYNTHESIS SYSTEM
AINSWORTH, WA
[J]. IEEE TRANSACTIONS ON AUDIO AND ELECTROACOUSTICS, 1972, AU20 (05): : 397 - +
[6] A Real-Time Text to Audio-Visual Speech Synthesis System
Wang, Lijuan
Qian, Xiaojun
Ma, Lei
Qian, Yao
Chen, Yining
Soong, Frank
[J]. INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5, 2008, : 2338 - +
[7] Real-Time 3D Tracking of Laparoscopy Training Instruments for Assessment and Feedback
Gautier, Benjamin
Tugal, Harun
Tang, Benjie
Nabi, Ghulam
Erden, Mustafa Suphi
[J]. FRONTIERS IN ROBOTICS AND AI, 2021, 8
[8] REAL-TIME SPEECH SPECTROGRAPHIC DISPLAY (SSD) WITH IMPLICATIONS FOR SPEECH TRAINING FOR DEAF
STEWART, LC
LARKIN, WD
HOUDE, RA
[J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1976, 59 : S69 - S69
[9] A REAL-TIME SPEECH DIALOG SYSTEM USING SPONTANEOUS SPEECH UNDERSTANDING
TAKEBAYASHI, Y
TSUBOI, H
KANAZAWA, H
SADAMOTO, Y
HASHIMOTO, H
SHINCHI, H
[J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 1993, E76D (01) : 112 - 120
[10] Real Time Feedback System for Speech Dysfluency in Children
Saldanha, Jennifer C.
Pinto, Rohan
[J]. SMART SENSORS MEASUREMENT AND INSTRUMENTATION, CISCON 2021, 2023, 957 : 75 - 91

← 1 2 3 4 5 →