Development of Hand Motion Tracking Device for Agricultural Machinery Simulator

Purpose: This study was carried out to develop a hand motion tracking system which recognizes the position and movement of the hand without using an IMU sensor for the development of a simulator for safety education of running agricultural machine. Methods: The hand gesture recognition system consists of a glove made of fabric, a tracker that measures the position and direction of the back of the hand (Tracker, VIBE, USA), a finger motion measurement and transmission device, and a data receiving device. By installing a hand gesture tracking system on the cultivator simulator, the difference between the lever position and the center of the hand position is measured when the drivers hold or hold the designated position of the actual main operating device (main clutch, main gear, auxiliary gear) with their hands. Result: The location-tracking experiments showed that the average distance difference between the x, y, z and axes averaged 8.00, 9.80 and 11.68 mm, respectively. Conclusion: The proposed hand gesture recognition system provides an environment for controlling objects in a virtual environment while minimizing the burden of equipment. Therefore, it was confirmed that real hand movements and virtual hand movements were implemented similarly to provide improved immersion and experience in virtual space. © 2021, The Korean Society for Agricultural Machinery.