CUAS Topic 6: Multi-Modal Decision Support Interfaces and Visualization

Planning, monitoring and controlling the coordinated operation of flocks of UAS's is complex due to the four-dimensional nature of their actions. 3D data of this type is very difficult for users to interpret and 2D 'radar' displays place a great cognitive load on the user, severely limiting the number of aircraft an operator can follow. This topic will address these issues through the creation of interactive information representations using 3D displays based on Virtual Reality (VR) as well as Augmented Reality (AR) technologies, in particular head-mounted displays (HMD). Such representations can allow the user to rapidly and clearly interpret the environment and monitor operations. HMDs will also be exploited for video feedback from the UAS's in a 'telepresence' mode: seeing in real-time through video cameras mounted on the UAS and, if necessary, taking direct control of the aircraft to resolve problems beyond the scope of the UAS's on-board systems.

Page responsible: Patrick Doherty
Last updated: 2015-01-22