A Mid-air Multi-touch Interface using an Ultrafast Pan-tilt Camera

We propose an interface that enables bare hand interaction with fingers of both hands even from a distance, using an ultrafast pan-tilt camera and a wide view camera. In this interface, a user can perform multi-touch interaction with a large display using midair finger motions. In order to acquire accurate finger motions required for multi-touch interaction, a wide view camera is used to detect the positions of the user's hands, and an ultrafast pan-tilt camera is utilized to obtain the images around the hands with high spatial resolution. In the experiments, we evaluated the accuracy of acquired finger motions, and showed that the proposed interface can capture both large motions of the user's whole body and small motions of the fingers with high accuracy. We also implemented two example applications, a drawing application and a photo layout application, using the proposed interface.