A Virtual Reality-Based Study of Dependable Human-Machine Interfaces for Communication between Humans and Autonomous or Teleoperated Construction Machines

Sammanfattning: The study aimed to identify and analyse methods for establishing external communication between humans and autonomous/teleoperated machines/vehicles using various Human-Machine Interfaces (HMIs). The study was divided into three phases. The purpose of the first phase was to identify and highlight previously tested/researched methods for establishing external communication by conducting a literature review. The findings from the literature review were categorised into six points of interest: machine indications, test delivery methods, HMI technologies/types, symbols, textual/numerical messages, and colours associated with different indications. Based on these findings, four HMIs (projection, display, LED-strip, and auditory) were selected for evaluation in a virtual reality environment for the second phase of the study, which has the purpose of identifying which of the human-machine interfaces can effectively communicate the intentions of autonomous/teleoperated machines to humans. The results of phase two indicate that the participants preferred projection as the most effective individual HMI, and when given the option to combine two HMIs, projection combined with auditory was the most preferred combination. The participants were also asked to pick three HMIs of their choosing, resulting in the projection, display and audible HMI combination being the preferred option. The evaluation of HMIs in a virtual reality environment contributes to improving dependability and identifying usability issues.  The objective of the third and final phase was to gather all the findings from the previous phases and subsequently refine the report until it was considered finalised. Future work includes enhancing the realism of the VR environment, refining machine behaviour and scenarios, enabling multiple participants to simultaneously interact with the environment, and exploring alternative evaluation methods. Addressing these areas will lead to more realistic evaluations and advancements in human-machine interaction research.