Action recognition based on binocular vision

Aimed at the problem that the recognition accuracy of the monocular camera is low, we propose a binocular vision recognition algorithm for action recognition based on HART-Net(Human action recognition networks). Firstly, the left and right views obtained by the binocular camera are matched to obtain the depth map of the human body. Then, the depth information is projected onto the three planes, the projection images of three directions are used to construct MHI (motion history image), and are combined into a new image. Finally, we use HART-Net to train a classifier for action recognition. Experimental results show that the binocular recognition algorithm is 18% more accurate than the monocular recognition algorithm.