Design and evaluation of human-computer interfaces for expert creative interaction

专家创造性交互的人机界面设计与评估

• 批准号: RGPIN-2021-03845
• 负责人: Malloch, Joseph
• 金额: $ 2.11万
• 依托单位: Dalhousie University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=750274
• 关键词: Design; evaluation; human; computer; interfaces

Digital artists, composers, and musicians form a class of extreme users whose demands of their systems include communication of personal style, mood, and expressive intent, and who are willing to spend countless hours both adapting and becoming accustomed to their tools (Mackay 2000). How to best design such tools is still an open question, and so this research program will address two main questions, which will be studied in parallel: a) how can hardware and software infrastructure support the creation, exploration and iterative development of such novel systems, and b) how to design and evaluate digital systems and interfaces for supporting creative practices by individual expert practitioners?. These infrastructures will not discriminate between designers and end-users, instead enabling users to continuously appropriate and redesign their tools. The first research question will explore the design, use and evaluation of modular, open--source software prototyping tools, building on the connectivity middleware libmapper (see e.g. Malloch, Sinclair, and Wanderley 2014; 2018) and its supporting ecosystem of language bindings and utilities such as session managers, data recorders, and protocol bridges. This base will be used to investigate tools for discovering, understanding and mapping (connecting) "interesting" signals found within large collections of streaming sensor data; integrating concepts from intermedia mapping and scripting tools, and comparing programming representations based on events to those based on streams in the context of live interactivity. Research on the second theme will make use of existing prototyping tools-and those developed by research theme 1 as they become available-to create and evaluate functional prototypes of novel human--computer interfaces for creative interaction with digital systems. These interfaces will be adapted for extreme personalisation to the idiosyncratic needs of the artist(s) or creator(s) involved. Evaluation through prolonged creative use of the interfaces will be valued more heavily than empirical measurements of e.g. speed or ergonomic efficiency.

数字艺术家、作曲家和音乐家构成了一类极端用户，他们对系统的要求包括个人风格、情绪和表达意图的交流，并且愿意花费无数的时间来适应和习惯他们的工具（Mackay 2000）。如何最好地设计此类工具仍然是一个悬而未决的问题，因此该研究计划将解决两个主要问题，这些问题将被并行研究：a）硬件和软件基础设施如何支持此类新颖系统的创建、探索和迭代开发，以及b）如何设计和评估数字系统和界面以支持个别专家从业者的创造性实践？这些基础设施不会区分设计者和最终用户，而是使用户能够不断地使用和重新设计他们的工具。第一个研究问题将探索模块化、开源软件原型工具的设计、使用和评估，该工具构建在连接中间件 libmapper（参见 Malloch、Sinclair 和 Wanderley 2014；2018）及其语言绑定和实用程序（例如会话管理器、数据记录器和协议桥）等支持生态系统的基础上。该基地将用于研究用于发现、理解和映射（连接）在大量流传感器数据中发现的“有趣”信号的工具；集成来自媒体映射和脚本工具的概念，并将基于事件的编程表示与基于实时交互上下文中的流的编程表示进行比较。第二个主题的研究将利用现有的原型工具（以及研究主题 1 开发的工具）来创建和评估新型人机界面的功能原型，以便与数字系统进行创造性交互。这些界面将根据相关艺术家或创作者的特殊需求进行极端个性化的调整。通过长期创造性地使用界面进行的评估将比经验测量更有价值。速度或人体工程学效率。