Force feedback virtual painting on real objects: A paradigm of augmented reality haptics

This paper presents a paradigm of augmented reality haptic through an application enabling the interaction on real objects with a virtual tool. In order to interact within the real world, a real haptic probe is used so that the user feels the interaction. Furthermore, through the use of a visual partial reality removal process and a camera placed on the real scene, the real tool is visually hidden in the visual feedback and replaced by the virtual tool. Since, the real and virtual probes do not necessarily match, a model of the virtual tool is used to adjust and tune the haptic feedback, while at the same time the virtual tool is visually rendered according to the real measured forces by the haptic probe. Eventually, proposing a mixed painting application, the painting, applied on the real object, i.e. when the user comes in contact with this latter, is visually displayed such that its form is computed from the virtual tool geometry while its size and intensity from the real measured forces.