Multi-Modal Supervision Interface Concept for Marine Systems

With increased orientation towards fleet operations, new technologies to improve autonomy and connectivity are needed. Most vehicles already come with mission planning and execution capabilities, and all state data is available remotely. With more autonomy, operators take on the supervision role for multiple vehicles. However, managing multiple vehicles in real-time requires supervisory interfaces that will reduce sensory overload. This presents a concept of an immersive user interface for supervision of marine systems. The augmented virtuality system provides a remote telepresence for operators with realtime interaction capabilities. The system focuses on providing situation awareness while maintaining operator capabilities. Data are streamed into the Unity3D interface through dedicated plugins, allowing two-way communication with LabView. Data is distilled into visual clues, while sound and speech recognition are employed to lessen the visual strain and improve interaction.