Command and control of industrial manipulator through speech-based interfaces in Indic Languages

被引：3

作者：

Saravanan, N. ^{[1
]}

Sivaramakrishnan, R. ^{[1
]}

机构：

[1] Madras Inst Technol, Prod Technol Dept, Chennai, Tamil Nadu, India

来源：

JOURNAL OF SUPERCOMPUTING | 2019年 / 75卷 / 08期

关键词：

Speech recognition and industrial robotics; Human-Robot interaction; !text type='Python']Python[!/text] speech recognition API; PocketSphinx; Android app; RECOGNITION;

D O I：

10.1007/s11227-019-02790-0

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Human-robot interaction has been a challenging task, and it involves various criteria to be considered including robot operator's caliber and his/her safety. Here in this project, we bring speech recognition to the rescue of robot operator, which has become a popular interface for human-computer interaction to recognize the speech of robot operator, to command and control the industrial robot. In this project, the five degree of freedom robotic arm is controlled through speech-based interfaces in Indic Languages, namely English (Indian accent), Hindi and Tamil. Python speech recognition API along with PocketSphinx is used for converting robot operator's speech commands to text form, and the command is translated and fed to the sophisticated servo controller for the actuation of robotic arm. A mobile application was also developed that can control the robot arm using HC-05 Bluetooth technology through speech-based interfaces.

引用

页码：5106 / 5117

页数：12

共 50 条

[1] Command and control of industrial manipulator through speech-based interfaces in Indic Languages
N. Saravanan
R. Sivaramakrishnan
[J]. The Journal of Supercomputing, 2019, 75 : 5106 - 5117
[2] WeldVUI: Establishing Speech-Based Interfaces in Industrial Applications
Augstein, Mirjam
Neumayr, Thomas
Pimminger, Sebastian
[J]. HUMAN-COMPUTER INTERACTION, INTERACT 2019, PT III, 2019, 11748 : 679 - 698
[3] Afan Oromo Speech-Based Computer Command and Control: An Evaluation with Selected Commands
Teshite, Kebede
Mamo, Getachew
Calpotura, Kris
[J]. ADVANCES IN HUMAN-COMPUTER INTERACTION, 2023, 2023
[4] Anticipation in speech-based human-machine interfaces
Ondas, Stanislav
Juhar, Jozef
Kiktova, Eva
Zimmermann, Julius
[J]. 2018 9TH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFOCOMMUNICATIONS (COGINFOCOM), 2018, : 117 - 121
[5] User interfaces for speech-based retrieval of lecture recordings
Hürst, W
[J]. ED-MEDIA 2004: World Conference on Educational Multimedia, Hypermedia & Telecommunications, Vols. 1-7, 2004, : 4470 - 4477
[6] Speech-based cursor control: understanding the effects of target size, cursor speed, and command selection
A. Sears
M. Lin
A.S. Karimullah
[J]. Universal Access in the Information Society, 2002, 2 (1) : 30 - 43
[7] Challenges in speech-based human-computer interfaces
Minker, Wolfgang
Pittermann, Johannes
Pittermann, Angela
Strauss, Petra-Maria
Buehler, Dirk
[J]. INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2007, 10 (2-3) : 109 - 119
[8] Designing Speech-Based Interfaces for Telepresence Robots for People with Disabilities
Tsui, Katherine M.
Flynn, Kelsey
McHugh, Amelia
Yanco, Holly A.
Kontak, David
[J]. 2013 IEEE 13TH INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS (ICORR), 2013,
[9] Generation of Adapted, Speech-based User Interfaces for Home and Building Automation Systems
Ploennigs, Joern
Jokisch, Oliver
Ryssel, Uwe
Hirschfeld, Diane
Kabitzsch, Klaus
[J]. WFCS 2008: IEEE INTERNATIONAL WORKSHOP ON FACTORY COMMUNICATION SYSTEMS, PROCEEDINGS, 2008, : 445 - +
[10] Compensate the Speech Recognition Delays for Accurate Speech-Based Cursor Position Control
Tong, Qiang
Wang, Ziyun
[J]. HUMAN-COMPUTER INTERACTION, PT II, 2009, 5611 : 752 - 760

← 1 2 3 4 5 →