Real time detection system of driver drowsiness based on representation learning using deep neural networks

One of the major issues of road accidents all over the world is drowsiness state of the driver. It is a complex phenomenon to measure a driver's consciousness in a direct manner. This work proposes with three deep neural architecture for learning facial features which consists of 68 attributes from the RGB video input of a driver. The experimentation is conducted by three different CNN models such as ResNet50, VGG16 and InceptionV3. These three networks are combined for representation learning which then put together the features to form a feature fused architecture(FFA). The trained features as well as facial movements such as eye blinking, yawning and head swaying are again trained with a softmax classifier to classify the drowsiness state of driver. Out of the three networks and FFA, InceptionV3 shows 78% accuracy.