Exploring new interaction possibilities for video game music scores using sample-based granular synthesis

Sammanfattning: For a long time, the function of the musical score has been to support activity in video games, largely by reinforcing the drama and excitement. Rather than leave the score in the background, this project explores the interaction possibilities of an adaptive video game score using real-time modulation of granular synthesis. This study evaluates a vertically re-orchestrated musical score with elements of the score being played back with granular synthesis. A game level was created where parts of the musical score utilized one granular synthesis stem, the parameters of which were controlled by the player. A user experience study was conducted to evaluate the granular synthesis interaction. The results show a wide array of user responses, opinions, impression and recommendations about how the granular synthesis interaction was musically experienced. Some results show that the granular synthesis stem is regarded as an interactive feature and have a direct relationship to the background music. Other results show that interaction went unnoticed. In most cases, the granular synthesis score was experienced as comparable to a more conventional game score and so, granular synthesis can be seen a new interactive tool for the sounddesigner. The study shows that there is more to be explored regarding musical interactions within games.