Sensing Music Interactions from the Outside-In: Accessible Innovation Fusing Wearable Technology and Physical Prototyping

从外到内感知音乐交互：融合可穿戴技术和物理原型的无障碍创新

• 批准号: MR/X036103/1
• 负责人: Thomas Mitchell
• 金额: $ 166.67万
• 依托单位: University of the West of England
• 依托单位国家: 英国
• 项目类别: Fellowship
• 财政年份: 2024
• 资助国家: 英国
• 起止时间: 2024 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=MR%2FX036103%2F1
• 关键词: Sensing; Music; Interactions; Outside; Accessible

This fellowship will critically examine longstanding assumptions of digital musical instrument (DMI) development and create new methods for co-designing customised instruments with physically impaired and non-technical musicians. The aim is to develop disruptive, speculative, and inclusive methods that reshape the fundamental practice of DMI design, inviting broader participation in the development of new musical instruments and future visions of musicianship. Musical instruments are rich cultural and technical artifacts that are used to translate human motion into sound. Embedded computation has led to an abundance of new DMIs, inspiring novel forms of music innovation in terms of performance and artistic expression. DMI development is a highly skilled interdisciplinary craft, combining music, engineering, manufacturing and ergonomics. Consequently, modern instrument design is exclusionary, and instruments are immutably ingrained with the cultural and technical assumptions of their creators, vastly reducing their potential for mass adoption and creating barriers to music innovation for non-technical and physically impaired musicians. Motion capture and gestural interaction technologies have shifted the locus of interaction away from physical objects and onto the body, realising human movement as the interface for performing music. However, the development of musical objects and gestural music interaction are often considered and pursued separately. By focusing on musical objects, instrument development is framed as a technical challenge assuming normative players and overlooking the diversity of musicians, audiences, and their environments. Gestural music interaction has shown great potential for music performance and accessibility; however, it neglects the significant role of tactile feedback in music training and the development of virtuosic performance. This fellowship will take a holistic approach, coupling gestural interaction and physical prototyping. The approach departs from the conventional practice of embedding sensing technologies within an instrument, and exploits a new, emerging paradigm that relocates the technology onto the body, sensing player interactions using wearable devices on the wrist and hand. A radical switch in both technical and design approach that opens innovative new research directions for low-cost, rapidly produced musical instruments, which can be designed to have any shape, scale or structure. Crucially, this provides new ways for people to participate in the rapid co-design of novel, customised musical instruments that are tailored to their unique access requirements and artistic identity. The fellowship addresses the UKRI priority areas of engineering, technology, AI, design research and the AHRC's Audience of the Future Challenge. The PI is ideally placed to examine this timely research opportunity, building on an extensive academic and entrepreneurial track record in gestural music systems. The Co-I and mentors are world leaders in their respective fields and strategic partnerships provide key accessibility guidance, links with Disabled communities and pathways for future impact. UWE, the host institution, plays a significant role in the West of England's (WoE) thriving creative industries and represents the ideal environment for this research. The fellowship will have the full support of the Centre for Print Research (CfPR), and will be located within The Bridge: a new £2.3M AHRC funded facility created to explore artistic applications of physical prototyping and interactive technologies (opening 2023). The fellowship supports time for the PI, Co-I and two postdoctoral research associates (RAs). The Co-I will support the development of embedded wearable technology (WT). One RA will explore participatory methods for co-designing customised musical interfaces. The other RA will focus on signal processing techniques to sense interactions with musical objects.

该奖学金将严格审查数字乐器（MIDI）发展的长期假设，并为与身体受损和非技术音乐家共同设计定制乐器创造新方法。其目的是开发颠覆性，投机性和包容性的方法，重塑音乐设计的基本实践，邀请更广泛的参与新乐器的开发和音乐事业的未来愿景。乐器是丰富的文化和技术文物，用于将人类运动转化为声音。嵌入式计算带来了大量新的DMI，在表演和艺术表达方面激发了新颖的音乐创新形式。音乐开发是一门高技能的跨学科工艺，结合了音乐，工程，制造和人体工程学。因此，现代乐器设计是排他性的，乐器与其创造者的文化和技术假设根深蒂固，大大降低了它们被大规模采用的潜力，并为非技术和身体受损的音乐家创造了音乐创新的障碍。动作捕捉和手势交互技术已经将交互的轨迹从物理对象转移到身体上，将人类运动实现为表演音乐的界面。然而，音乐对象的发展和手势音乐互动往往被单独考虑和追求。通过专注于音乐对象，乐器开发被视为一项技术挑战，假设规范的球员，忽视了音乐家，观众和他们的环境的多样性。手势音乐交互在音乐表现和可及性方面显示出巨大的潜力，但它忽视了触觉反馈在音乐训练和演奏能力发展中的重要作用。这个奖学金将采取整体的方法，耦合手势交互和物理原型。这种方法不同于将传感技术嵌入乐器的传统做法，而是利用了一种新的新兴范式，将技术重新定位到身体上，使用手腕和手上的可穿戴设备来感测玩家交互。技术和设计方法的根本转变，为低成本，快速生产的乐器开辟了创新的新研究方向，可以设计成任何形状，规模或结构。至关重要的是，这为人们提供了新的方式来参与快速共同设计新颖的定制乐器，这些乐器是根据他们独特的访问要求和艺术身份定制的。该奖学金涉及工程，技术，人工智能，设计研究和AHRC的未来挑战的观众的UKRI优先领域。PI非常适合研究这个及时的研究机会，建立在手势音乐系统的广泛学术和创业记录的基础上。Co-I和导师是各自领域的世界领导者，战略伙伴关系提供关键的无障碍指导，与残疾人社区的联系以及未来影响的途径。主办机构UWE在英格兰西部（WoE）蓬勃发展的创意产业中发挥着重要作用，并代表了这项研究的理想环境。该奖学金将得到印刷研究中心（CfPR）的全力支持，并将位于桥内：一个新的230万英镑AHRC资助的设施，旨在探索物理原型和交互技术的艺术应用（2023年开放）。该奖学金支持PI，Co-I和两名博士后研究助理（RA）的时间。Co-I将支持嵌入式可穿戴技术（WT）的开发。一个RA将探索参与式方法，共同设计定制的音乐界面。另一个RA将专注于信号处理技术，以感知与音乐对象的互动。