Composition and Arrangement Techniques for Music in Interactive Immersive Environments
Composition and Arrangement Techniques for Music in Interactive Immersive Environments
复制标题
互动沉浸式环境中的音乐作曲与编曲技巧
DOI：
--
复制
发表时间：
2006
期刊：
影响因子：
--
通讯作者：
Maic Masuch
中科院分区：
文献类型：
--
作者：
Axel Berndt;K. Hartmann;N. Röber;Maic Masuch
受到电影音乐的戏剧性和情感效果的启发，我们的目标是将音乐无缝地集成到交互式沉浸式应用程序中——尤其是在电脑游戏中。在这两种情况下，同步视觉和听觉内容至关重要。因此，电影的最终剪辑通常会根据配乐进行调整，反之亦然。然而，在交互式应用程序中，音乐引擎必须根据玩家的交互自动调整乐谱。此外，音乐效果应该非常微妙，即。即，必须避免任何异步硬剪切，并且应隐藏多次重复。本文提出了解决具有挑战性的问题的策略，使游戏音乐与不可预测的玩家交互行为同步和适应。为了融入人类作曲家富有表现力的乐谱，我们扩展了传统的作曲和编曲技术，并引入了在交互式应用程序的背景下编曲和编辑音乐的新方法。作曲家可以将乐谱分割成基本主题的节奏、旋律或和声变体，如音乐骰子游戏中已知的那样。这些基本元素的各个部分被分配来表征游戏元素的特征。此外，作曲家或游戏设计师可以指定玩家交互如何触发音乐元素之间的变化。为了评估音乐的连贯性、一致性，并获得作曲限制、优势和可能性的经验，我们在两个交互式沉浸式应用程序中应用了这项技术。
Inspired by the dramatic and emotional effects of film music, we aim at integrating music seamlessly into interactive immersive applications — especially in computer games. In both scenarios it is crucial to synchronize their visual and auditory contents. Hence, the final cut of movies is often adjusted to the score or vice versa. In interactive applications, however, the music engine has to adjust the score automatically according to the player’s interactions. Moreover, the musical effects should be very subtle, i. e., any asynchronous hard cuts have to be avoided and multi-repetitions should be concealed. This paper presents strategies to tackle the challenging problem to synchronize and adapt the game music with nonpredictable player interaction behaviors. In order to incorporate expressive scores from human composers we extend traditional composition and arrangement techniques and introduce new methods to arrange and edit music in the context of interactive applications. Composers can segment a score into rhythmic, melodic, or harmonic variations of basic themes, as known from musical dice games. The individual parts of these basic elements are assigned to characterize elements of the game play. Moreover, composers or game designers can specify how player interactions trigger changes between musical elements. To evaluate the musical coherency, consistency, and to gain experience with compositional limitations, advantages and possibilities, we applied this technique within two interactive immersive applications.