Implementation and Evaluation of Touch and Gesture Interaction Modalities for In-vehicle Infotainment Systems

The arrival of the Internet of Vehicles has promoted the transformation of in-vehicle human-computer interaction. As a new way of human-computer interaction, gesture interaction plays an important role in such interaction and technology update. This paper proposes the implementation of an in-vehicle driving simulator that allows infotainment system to be controlled by dynamic hand gestures and touch screen. Thirty participants were asked to interact with the infotainment system in two ways separately and randomly while performing the driving test. Moreover, three kinds of data related to the degradation of the driver's performance, including driving efficacy, visual attention and subjective workload were collected. In addition, the fuzzy comprehensive evaluation method is used to evaluate the usability of interactive gestures. The experimental results show that compared with the touch screen interaction, gesture control significantly reduces the driver's distraction and improves safety during driving.