Human-Multi-Drone Interaction in Search and Rescue Systems under High Cognitive Workload

Sammanfattning: Unmanned Aerial Vehicles (UAV), often referred to as drones, have seen increased use in search and rescue (SAR) missions. Traditionally, these missions involve manual control of each drone for aerial surveillance. As UAV autonomy progresses, the next phase in drone technology consists of a shift to autonomous collaborative multi-drone operations, where drones function collectively in swarms. A significant challenge lies in designing user interfaces that can effectively support UAV pilots in their mission without an overload of information from each drone and of their surroundings. This thesis evaluates important human factors, such as situational awareness (SA) and cognitive workload, within complex search and rescue scenarios, with the goal of increasing trust in multi-drone systems through the design and testing of various components. Conducting these user studies aims to generate insights for the future design of multi-drone systems. Two prototypes were developed with a multi-drone user interface, and simulated a stressful search and rescue mission with high cognitive workload. In the second prototype, a heatmap guided UAV pilots based on the lost person model. The prototypes were tested in a conducted user study with experienced UAV pilots in different SAR organizations across Sweden. The results showed variability in SA while monitoring drone swarms, depending on user interface components and SA levels. The prototypes caused significant cognitive workload, slightly reduced in the heatmap-equipped prototype. Furthermore, there was a marginal increase in trust observed in the prototype with the heatmap. Notably, a lack of manual control raised challenges for the majority of participants and many desired features were suggested by participants. These early expert insights can serve as a starting point for future development of multi-drone systems.