Interactivity in Audio-visual Musical Pieces Based on the Descriptive Language MAX

在这个项目中，研究对象包括伦敦、维也纳、林茨、因斯布鲁克、巴黎、东京、京都、名古屋等地的音乐作品、互动音乐艺术、包括音乐或声音在内的媒体艺术、电脑声音艺术。这项研究首先分析了这些作品作为音乐和舞台上的表演艺术。作品包括电脑音响舞蹈和互动系统。动作、形式及其变化过程是舞蹈作品和互动音乐作品的表现参数。但在音乐作品中，运动或形式及其变化过程总是与发声或音乐思维有关。因此，可以说，音乐作品中的互动，即使包括交互式视听系统，也应该集中在音乐动作上，即制作音乐的动作，即演奏乐器、发声、联系合奏等。在交互式音乐语境中，演奏时演奏导致交互界面研究，表演时发出声音导致音频处理，在MAX/MSP中，联系演奏导致集成系统，包括视频效果或运动跟踪以及使人能够在音乐作品中进行交流的音乐逻辑。发声方面和交流方面作为当今人机交互的重要框架被讨论。如何通过映射在技术上和语义上构建音乐数据的方式被重新考虑为个人作品的艺术要点。从发声和传播的角度考察了包括原始映射思想在内的四首音乐作品。

In this project, pieces of music, interactive musical art, media art including music or sound, sound art with computer were researched in London, Vienna, Linz, Innsbruck, Paris, Tokyo, Kyoto, Nagoya. The research began with analyzing the pieces both as music and as performing art on the stage. Pieces include dance with computer sound and interactive system. Motion, form and their changing process are the expressive parameters both in dance and interactive musical pieces. But in musical pieces the motion or form and their changing process always concern about sounding or musical thinking. So it can be said that interactivity in musical pieces, even if they include interactive audio-visual system, should concentrate musical action, that is, the action of making music, i.e. playing the instruments, voicing, contacting for ensemble etc. In the interactive musical context, performing as instrument playing leads to interactive interface research, performing as voising leads to audio processing as in MAX/msp, and contacting for ensemble leads to integrating system including video effect or motion tracking as well as musical logic which enables human communication in musical pieces. Sounding aspects and communication aspects are discussed as important frameworks for today's situation of human computer interaction. The way how the music data is structured technically and semantically by mapping is reconsidered as the artistic main point in the individual piece. Four musical pieces including the original mapping ideas are examined in the viewpoints of sound gen-erating and communication.