Design of Upper Limb Rehabilitation Training System Combining BCI and AR Technology

This paper designed an upper limb rehabilitation training system combining AR technology and BCI technology for upper limb function of stroke patients. The system is divided into two phases :(1) AR-SSVEP phase, EEG signals of patients were collected in real-time by two different scintillation frequency squares, which adapt patients to the AR environment and focus; (2) AR-MI phase, the patient imagines the motion of the hand according to the instruction of the light, real-time acquisition of EEG signals and analysis of patient intentions, and given the feedback on AR technology, which let patients have a better visual experience so that can complete rehabilitation training better. This system uses 3dsMax to build AR scene and 3D character s upper limb and its animations, then import into Unity software with the AR kit to build as AR interface, after packaging, finally build the program into the HoloLens device. The system has the characteristics of multilevel, portable, immersion, real-time and so on. It provides a new method for the rehabilitation of upper limb function in stroke patients, and portability of brain-computer interface and visual stimulation.