Silent Speech Interface Using Lip-Reading Methods

被引:0
|
作者
Jothibalaji, Raghupathy [1 ]
Adithya, S. Siva [1 ]
Saravanan, N. V. [1 ]
Dhanalakshmi, M. [1 ]
机构
[1] Sri Sivasubramaniya Nadar Coll Engn, Dept Biomed Engn, Chennai 603110, India
关键词
Silent Speech Interface; Total Laryngectomy; Image processing; EXTRACTION;
D O I
10.1007/978-3-031-54547-4_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A silent speech interface (SSI) maps articulatory movement data to forecast the speech of mute people. SSIs have vast potential for improving oral communication in peoplewho have had laryngectomy surgery or thosewith severe voice abnormalities. In this paper, wepresent a lip-reading recognition algorithm to recognize Englishwords from the lipswhen speaking. The lip contour and English words were distinguished using a variety of lip metric metrics, including width, height, contour points, area, and ratio (width/height). In this test, fifteen talkers mouthed (silently articulated) sentences to finish a phrase-reading assignment in an experimental setting. Among the fifteen participants, 89% and 81% of the mouthed phrases were correctly recognized for two different classifier cases respectively. The automated ROI detection, elimination of lip shape effects, and operation without prior data training are strengths of the proposed method. The experimental outcomes showed the viability and potential of lip-reading-based silent speech interfaces for future clinical applications.
引用
收藏
页码:9 / 23
页数:15
相关论文
共 50 条