Immersive Experience-based Cooperative Interaction for Computer Assembly Guidance

This paper proposes a scenario-interactive computer assembly guidance system, in which virtual computer parts are modeled by 3D modeling software, and assembly virtual scene is built by virtual engine. During the assembly process, multiple users can interact with virtual components to well understand the key components of the computer with the installation notices. Also, the system determines whether the corresponding components are installed correctly through collision detection and distance judgment. The additional communication module brings about the synchronization of model information among multiple VR devices to achieve a "oneto-many" teaching mode. Meanwhile, voice recognition technology facilitates the information exchange among multiple VR users, which bring about the simultaneous learning and communication among multiple users with highly cooperative interaction in the assembly process. Experimental tests show that the proposed system has a complete set of functional modules with the high fidelity. The interactive operation provided by the virtual scene facilitates the beginners to collaborate, communicate and learn. Especially It does not only avoid the risks caused by the improper real-time operation, but also solve the obscure and uninteresting problem of traditional interaction for beginners.