A study on visual, auditory, and haptic feedback for assembly tasks

Telepresent tasks involve removal of the human operator from an immediate working area and relocation to a remote environment that offers the operator all necessary control features. In this remote location, the operator must be provided with adequate feedback information such that the task at hand can be effectively executed. This research explores the effectiveness of various feedback methods. More specifically, graphical feedback in the form of video streamed images is compared against rendered 3D models, the overall effectiveness of haptic feedback is analyzed, and the influences of sensory augmentation and sensory substitution are examined. This study involved 48 participants, each of whom executed a simple clockwork assembly task under various feedback mechanisms. The results support the use of 3D models as opposed to live video streams for graphical presentation, utilization of haptic feedback (which was found to significantly enhance operation effectiveness), and the use of sensory augmentation and substitution under specific circumstances.