Integration of gaze and gesture detection in nature language instructing of robot in an assembly scenario

被引：0

作者：

Zhang, JW ^{[1
]}

Baier, T ^{[1
]}

Hueser, M ^{[1
]}

机构：

[1] Univ Hamburg, Dept Comp Sci, D-22527 Hamburg, Germany

来源：

IEEE ROMAN 2002, PROCEEDINGS | 2002年

关键词：

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We present the development of and experiment with a robot system showing multimodal interaction capabilities. We focus on the understanding human instructions in natural language by integrating gaze and pointing hand gestures. A typical application of such a system is interactive assembly. A human communicator sharing a view of the assembly scenario with the robot instructs the latter by speaking to it in the same way that he would communicate with a child. His instructions can be under-specified, incomplete and/or context-dependent. By detecting gaze and gesture information of the instructor, which are described in two sections of the paper, the ambiguities in the interactions can be dissolved in a natural manner. Finally, we outline a list of future research topics for extending our research.

引用

页码：241 / 246

页数：6

共 2 条

[1] Gaze detection as a social cue to initiate natural human-robot collaboration in an assembly task
Nicora, Matteo Lavit
Prajod, Pooja
Mondellini, Marta
Tauro, Giovanni
Vertechy, Rocco
Andre, Elisabeth
Malosio, Matteo
FRONTIERS IN ROBOTICS AND AI, 2024, 11
[2] Enhancing Human-Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition
Paul, Shuvo Kumar
Nicolescu, Mircea
Nicolescu, Monica
SENSORS, 2023, 23 (13)

← 1 →