Crossmodal Perception of Emotion in Audiovisual Scenes of Knocking Sounds

Sammanfattning: Sound is an important aspect of storytelling. Previous studies have investigated the emotional perceptions of knocking sounds, in relation to the colour and material of the door. This study will build on these projects and investigate two new visual factors, colour grading and the speed at which a door opens, to determine how they affect emotional perception in isolation, and then how they interfere with five expressive knocking sounds. This was done by conducting four experiments. The first two experiments investigated the emotional perception of the visual factors. In the last two experiments, the visual factors were combined with the expressive knocking sounds, in order to investigate how the conveyed emotions of these visual factors interfered with the perceived emotions of the knocking sounds. The results showed that the knocking sounds had the strongest influence over the overall perceived emotion. However, the colour gradings were able to influence and interfere with the perceived emotion of the knocking sounds, while the door opening speeds did not have an effect.