Connections between sound composition and visual art through the transformation of sound material into 3D objects and sonic spaces

当代声学音乐--以录音为素材的音乐--的一个固有问题是其音源的无形性，以及它能在非专业观众中产生的超然，这限制了它的公众影响力。这项拟议的研究解决了这个问题，寻求以声音为基础的作曲的“对象化”方法，使音乐、绘画和雕塑成为一个完全整合的多模式艺术对象，在审美体验中集体和互动地调动听觉、视觉和触觉。人类的知觉本质上是多感官的。神经元将跨感官的信号整合为交叉模式联系(Stein Stanford，2008)。有些对应是自然地联系在一起的，比如音高和高度、听觉音量和视觉亮度(Spence&Parise 2009)，但不匹配的刺激(气味、触觉、颜色和情感)的交叉模式混合整合成复杂的、混合的感觉信息，产生更丰富的审美体验。将这些知识应用于艺术实践是一个充满潜力的领域，但迄今很少受到关注。我的工作旨在解决这个问题。它以实践和跨学科为基础，将涉及对互动做出反应的艺术作品和装置的创作，调查音乐、视觉艺术和触觉之间的多感觉相互联系--跨模式联系或对应--结合空间化的声音、3D对象和用户界面。通过这样做，它提供了让观众参与创作过程的新方法。

An inherent problem in contemporary acousmatic music-music which uses recorded sound as its material-is the intangibility of its sound sources and the detachment it can generate in non-expert audiences, which limits its public reach. The proposed research addresses this issue, seeking means for the 'objectification' of sound-based composition, whereby music, drawing and sculpture become a fully integrated multimodal art object which mobilises the aural, visual and tactile senses collectively andinteractively in the aesthetic experience. Human perception is multisensory in nature. Neurons integrate signals across the senses as crossmodal associations (Stein Stanford 2008). Some correspondences are naturally associated, like pitch andelevation, auditory volume and visual brightness (Spence & Parise 2009), but crossmodal blending of mismatched stimuli (smell, touch, colour, and emotions) integrate into complex, hybridised sensory information, yielding richer aesthetic experiences.The application of such knowledge within artistic practice is an area rich with potential, yet has thus far received little attention. My work aims to address this. Practice-based and transdisciplinary, it will involve the creation of artworks and installations responsive to interaction, investigating the multisensory interconnections - crossmodal associations or correspondences - between music, the visual arts and haptics, combining spatialized sound, 3D objects and user interfaces. In doing so it offers new ways of engaging audiences in the creative process.