Musical skin: a dynamic interface for musical performance. (English)
Jacko, Julie A. (ed.), Human-computer interaction. Interaction techniques and environments. 14th international conference, HCI international 2011, Orlando, FL, USA, July 9‒14, 2011. Proceedings, Part II. Berlin: Springer (ISBN 978-3-642-21604-6/pbk). Lecture Notes in Computer Science 6762, 53-61 (2011).
Summary: Compared to pop music, the audience of classical music has decreased dramatically. Reasons might be the way of communication between classic music and its audience that depends on vocal expression such as timbre, rhythm and melody in the performance. The fine details of classic music as well its implied emotion among the notes become implicit to the audience. Thus, we apply a new media called dynamic skin for building up the interface between performers and audiences. Such interface is called “Musical Skin” is implemented with dynamic skin design process with the results from gesture analysis of performer/audience. Two skins-system of Musical Skin are implemented with virtual visualization/actuators/sensible spaces. The implementation is tested using scenario and interviews.