Sensing Music Interactions from the Outside-In: Accessible Innovation Fusing Wearable Technology and Physical Prototyping

从外到内感知音乐交互：融合可穿戴技术和物理原型的无障碍创新

• 批准号: MR/X036103/1
• 负责人: Thomas Mitchell
• 金额: $ 166.67万
• 依托单位: University of the West of England
• 依托单位国家: 英国
• 项目类别: Fellowship
• 财政年份: 2024
• 资助国家: 英国
• 起止时间: 2024 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=MR%2FX036103%2F1
• 关键词: Sensing; Music; Interactions; Outside; Accessible

This fellowship will critically examine longstanding assumptions of digital musical instrument (DMI) development and create new methods for co-designing customised instruments with physically impaired and non-technical musicians. The aim is to develop disruptive, speculative, and inclusive methods that reshape the fundamental practice of DMI design, inviting broader participation in the development of new musical instruments and future visions of musicianship. Musical instruments are rich cultural and technical artifacts that are used to translate human motion into sound. Embedded computation has led to an abundance of new DMIs, inspiring novel forms of music innovation in terms of performance and artistic expression. DMI development is a highly skilled interdisciplinary craft, combining music, engineering, manufacturing and ergonomics. Consequently, modern instrument design is exclusionary, and instruments are immutably ingrained with the cultural and technical assumptions of their creators, vastly reducing their potential for mass adoption and creating barriers to music innovation for non-technical and physically impaired musicians. Motion capture and gestural interaction technologies have shifted the locus of interaction away from physical objects and onto the body, realising human movement as the interface for performing music. However, the development of musical objects and gestural music interaction are often considered and pursued separately. By focusing on musical objects, instrument development is framed as a technical challenge assuming normative players and overlooking the diversity of musicians, audiences, and their environments. Gestural music interaction has shown great potential for music performance and accessibility; however, it neglects the significant role of tactile feedback in music training and the development of virtuosic performance. This fellowship will take a holistic approach, coupling gestural interaction and physical prototyping. The approach departs from the conventional practice of embedding sensing technologies within an instrument, and exploits a new, emerging paradigm that relocates the technology onto the body, sensing player interactions using wearable devices on the wrist and hand. A radical switch in both technical and design approach that opens innovative new research directions for low-cost, rapidly produced musical instruments, which can be designed to have any shape, scale or structure. Crucially, this provides new ways for people to participate in the rapid co-design of novel, customised musical instruments that are tailored to their unique access requirements and artistic identity. The fellowship addresses the UKRI priority areas of engineering, technology, AI, design research and the AHRC's Audience of the Future Challenge. The PI is ideally placed to examine this timely research opportunity, building on an extensive academic and entrepreneurial track record in gestural music systems. The Co-I and mentors are world leaders in their respective fields and strategic partnerships provide key accessibility guidance, links with Disabled communities and pathways for future impact. UWE, the host institution, plays a significant role in the West of England's (WoE) thriving creative industries and represents the ideal environment for this research. The fellowship will have the full support of the Centre for Print Research (CfPR), and will be located within The Bridge: a new £2.3M AHRC funded facility created to explore artistic applications of physical prototyping and interactive technologies (opening 2023). The fellowship supports time for the PI, Co-I and two postdoctoral research associates (RAs). The Co-I will support the development of embedded wearable technology (WT). One RA will explore participatory methods for co-designing customised musical interfaces. The other RA will focus on signal processing techniques to sense interactions with musical objects.

该奖学金将严格研究数字乐器（DMI）开发的长期假设，并创建新的方法，用于与身体受损和非技术音乐家共同设计定制的乐器。目的是开发破坏性，投机性和包容性的方法来重塑DMI设计的基本实践，邀请更广泛地参与新的乐器的发展以及未来的音乐家视觉。乐器是丰富的文化和技术文物，用于将人类运动转化为声音。嵌入式计算导致了大量的新DMI，从表演和艺术表达方面激发了新的音乐创新形式。 DMI Development是一款高技能的跨学科飞船，结合了音乐，工程，制造和人体工程学。因此，现代仪器设计是排他性的，并且仪器与创作者的文化和技术假设无缘根深蒂固，从而大大降低了其大规模收养的潜力，并为非技术和物理障碍的音乐家创造了音乐创新的障碍。运动捕获和手势相互作用技术已将相互作用的轨迹从物理对象转移到身体上，从而将人类运动视为表演音乐的界面。但是，音乐对象和手势音乐互动的发展经常被分开考虑和追求。通过专注于音乐对象，仪器开发被构成技术挑战，假设正常玩家并忽略了音乐家，观众及其环境的多样性。手势音乐互动显示出音乐表演和可访问性的巨大潜力。但是，它忽略了触觉反馈在音乐训练和精通绩效发展中的重要作用。该奖学金将采用整体方法，耦合手势互动和物理原型。该方法与将灵敏度技术嵌入仪器中的传统实践背道而驰，并利用了一种新的新兴范式将技术转移到人体上，从而使用手腕和手上可穿戴的设备来感知玩家的互动。技术和设计方法的激进开关为低成本，快速生产的乐器打开了创新的新研究方向，可以设计出任何形状，比例或结构。十足的是，这为人们提供了新的方式，可以参与针对其独特的访问要求和艺术身份量身定制的新颖，定制乐器的快速共同设计。这些奖学金介绍了工程，技术，AI，设计研究和AHRC未来挑战的乌克里优先领域。 PI只是为了检查这个及时的研究机会，并建立在手势音乐系统中广泛的学术和企业家记录的基础上。 Co-I和导师是各自领域的世界领导人，战略合作伙伴关系提供了关键的可访问性指导，与残疾社区的联系以及未来影响的途径。东道国乌韦（Uwe）在英格兰（Wore）的蓬勃发展的创意产业中发挥了重要作用，代表了这项研究的理想环境。该奖学金将得到印刷研究中心（CFPR）的全部支持，并将位于桥梁：新的230万英镑AHRC资助的设施，旨在探索物理原型和互动技术的艺术应用（开放2023）。该奖学金支持PI，CO-I和两名博士后研究助理（RAS）的时间。 Co-I将支持嵌入式可穿戴技术（WT）的开发。一个RA将探索共同设计定制音乐界面的参与方法。另一个RA将专注于信号处理技术，以感知与音乐对象的相互作用。