Examining the effects of text support and noise during video meetings on listening effort and comprehension.

Sammanfattning: Many companies implemented remote work procedures during the pandemic and for many organizations video meetings have since remained a staple. Remote working has enabled employees to be more flexible with their schedules and technical solutions such as live captioning has been identified as potentially enabling deaf/hard-of-hearing employees during meetings. However with new procedures comes concern about how we potentially can be affected by the changes. Some earlier research has shown that speech intelligibility can be improved by the inclusion of text support, but they also raised the possibility that it could have unwanted adverse effects on cognitive abilities (Zhong, Noud et al., 2022). This study was conducted with this focus, studying the effects of text support on specifically listening effort and comprehension during normal as well as adverse conditions (featuring added noise). To investigate the effects of text support a 2 (Noise, No Noise) x 2 (Text Support, No Text Support) design was used. The participants were shown 16 short videos simulating video meetings and after each video were asked to rate their perceived listening effort as well as a comprehension question about the contents of the discussion. Each of the four conditions were equally represented but the order of the specific video files and conditions that applied were randomised for each participant to mitigate undue effects. The results of the study indicate that the presence of captions decrease effort and raise comprehension in both normal and adverse conditions. Noise was found to strongly effect the listening effort required by participants but no significant effect was found upon comprehension. Some concerns regarding the ecological validity were identified during the course of the study such as only studying energetic noise and unrealistic presentation of captions. However the results are nonetheless believed to be generalizable in most regards and showcase that captions can have a positive influence during video meetings.