Fast and Accurate Prototyping of Input Devices for Expert Interaction

快速准确的专家交互输入设备原型设计

• 批准号: RGPIN-2014-05672
• 负责人: Wanderley, Marcelo
• 金额: $ 1.89万
• 依托单位: McGill University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2017
• 资助国家: 加拿大
• 起止时间: 2017-01-01 至 2018-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=634277
• 关键词: Fast; Accurate; Prototyping; Input; Devices

This research proposal aims to explore the development of innovative software and hardware systems for human-computer interaction in musical contexts. It will support my long-term research work focusing on the application of electronics and software development to the design of digital musical instruments (DMIs), instruments that are based on an input device that controls sound (and/or other media) generated by software algorithms. The design of DMIs is a research field that has received substantial attention in the last decade, thanks in part to the international conference on New Interfaces for Musical Expression (NIME) and to an increasingly large community of do-it-yourself designers. In this proposed research, I will approach the design and evaluation of DMIs from three perspectives: - Rapid Prototyping of DMIS: The design of innovative DMIs taking advantage of rapid prototyping tools such as 3D printers and laser cutters, allowing for the creation of unique device forms adapted to user needs in a fast development-test cycle. This fast cycle is essential in collaborative projects involving expert performers, who need to have immediate access to devices so that they can provide feedback to designers on where to improve them. - Sensor Fusion and Embedded Computing for DMIS: The use of advanced instrumentation techniques such as sensor fusion, or the combination of data from several sensors processed by a variety of digital signal processing techniques. Sensor fusion, in tandem with advanced instrumentation techniques for processing raw sensor data, can lead to the design of responsive DMIs for interactive applications that demand accurate and repeatable performance measurements (Medeiros & Wanderley, under review). Together with embedded sound synthesis and tools for mapping such as libmapper, it will be possible to create self-contained, responsive DMIs.- Refinement of a methodology for the evaluation of DMIs: Building upon our recent work and on the recent contributions to the DMI literature, we will refine a methodology for the evaluation of DMIs using a combination of qualitative and quantitative methodologies to understand how performers interact with their instruments and how performance expertise develops over time. This understanding will be in turn important to inform the design of novel DMIs. The expected impacts of the research are numerous, both in terms of training high-qualified personnel in a multi-disciplinary research context, and in commercial and social benefits derived from the development of tools for musical expression and for the interaction with computers in expert contexts.

该研究计划旨在探索音乐环境中人机交互的创新软件和硬件系统的开发。它将支持我的长期研究工作，重点是电子和软件开发在数字乐器 (DMI) 设计中的应用，这些乐器基于控制软件算法生成的声音（和/或其他媒体）的输入设备。 DMI 的设计是一个在过去十年中受到广泛关注的研究领域，这在一定程度上要归功于音乐表达新界面 (NIME) 国际会议以及日益庞大的 DIY 设计师社区。在这项拟议的研究中，我将从三个角度进行 DMI 的设计和评估： - DMIS 的快速原型设计：利用 3D 打印机和激光切割机等快速原型设计工具设计创新的 DMI，从而可以在快速开发测试周期中创建适应用户需求的独特设备形式。这种快速的周期对于涉及专家执行者的协作项目至关重要，他们需要立即访问设备，以便向设计人员提供有关改进之处的反馈。 - DMIS 的传感器融合和嵌入式计算：使用先进的仪器技术，例如传感器融合，或组合来自多个传感器的数据，并通过各种数字信号处理技术进行处理。传感器融合与处理原始传感器数据的先进仪器技术相结合，可以为需要精确和可重复性能测量的交互式应用设计响应式 DMI（Medeiros 和 Wanderley，正在审查中）。与嵌入式声音合成和 libmapper 等映射工具一起，将有可能创建独立的、响应式的 DMI。 - 完善 DMI 评估方法：基于我们最近的工作和最近对 DMI 文献的贡献，我们将使用定性和定量方法相结合来完善 DMI 评估方法，以了解表演者如何与其乐器互动以及如何进行互动。 绩效专业知识随着时间的推移而发展。这种理解反过来对于新型 DMI 的设计也很重要。这项研究的预期影响是多方面的，无论是在多学科研究背景下培训高素质人才，还是在开发音乐表达工具以及在专家背景下与计算机交互所带来的商业和社会效益方面。