[7A] Human Interface

[7A-06] Design study of video production system for audience enjoying orchestra performance

*Satoki Mohri¹, Masahito Tsuchiya¹ (1. Hosei University)

Keywords:interface design, program music, visual impression

This study is a proposal of a video system for orchestra beginners to enjoy program music in an orchestra. Program music is a type of instrumental art music that attempts to render an extra-musical narrative musically. While orchestra-goers are older, parents, children, and beginners like performances that combine video and performance. So that the emotions that the music encompasses are algorithmically analyzed and expressed in the video. A prototype of a video system was created in which the size and movement of figures evoking emotions fluctuate in real time according to the movement of the conductor and the volume of the performance. Performance evaluation experiments showed that the prototype was effective in recognizing musical emotion. Future goals include increasing the variety of emotions and adding color to the images.