Hand Segmentation and Fingertip Detection for Interfacing of Stereo Vision-based Smart Glasses

In this paper, we propose a hand segmentation and fingertip detection method for interacting with projected digital contents in the binocular smart glasses, with a built-in stereo cameras. In order to make robust hand segmentation under the various environmental conditions, we used the adaptive skin color model which is created by fusion of depth and color information. Also, we have defined the finger range to reduce time complexity and to find correct fingertip in the process of fingertip detection. Since it provides a stable hand gesture interface, it can be applied to various applications for smart glasses without the restriction of the mobility and the inconvenience.