Detecting User Emotions with the True-Depth Camera to Support Mobile App Quality Assurance

Nowadays, fast time to market and high quality need to be considered in the development of mobile apps. One relevant quality aspect is user experience. An essential part of user experience are user emotions. However, feedback tools usually do not provide information about a user's emotions. In this paper, we present an approach that utilizes newly available 3D-sensing cameras on smartphones. We built a model where facial muscles were connected to corresponding action units and subsequently to six basic emotions. With this, we were able to automatically identify the emotions of users while they were using an app. This will help developers understand what users like and do not like regarding their apps. Such feedback can then be used as an additional source of information for subsequent app development activities.