Expressive Auditory Gestures in a Voice-Based Pedagogical Agent

In this paper, we explore how expressive auditory gestures added to the speech of a pedagogical agent infuence the human-agent relationship and learning outcomes. In a between-subjects experiment, 41 participants assumed the role of a tutor to teach a voice-based agent. The agent used either: expressive interjections (e.g.,"yay", "hmm", "oh"), brief expressive musical executions, or no auditory gestures at all (control condition), throughout the interaction. Overall, the results indicate that both gestures can positively afect the interaction, but in particular, interjections can signifcantly increase feelings of emotional rapport with the agent and enhance motivation in learners. The implications of our fndings are discussed as our work adds to the understanding of conversational agent design and can be useful for education as well as other domains in which dialogue systems are used.