Stereoscopic Vision System for Human Gesture Tracking and Robot Programming by Demonstration

This paper presents a framework for robot programming by demonstration using gesture. It is based on a luminous multi-LED marker which is captured by a pair of industrial cameras. Using stereoscopy the marker supplies a complete 6-DoF human gesture tracking output with both position and orientation. Tests show that the developed setup is industrial grade, being precise for many industrial applications and robust particularly to lighting conditions. Attaching the marker to an operator work tool provides an efficient way to track the human movements without further intrusion in the process. The resulting path is used to generate a program for an industrial manipulator ending the cycle in an human-robot skill transfer framework.