Design and evaluation of human-computer interfaces for expert creative interaction

数字艺术家，作曲家和音乐家形成了一类极端用户，他们对系统的需求包括个人风格，情绪和表达意图的交流，并且愿意花费无数时间来适应和习惯他们的工具（Mackay 2000）。如何最好地设计这样的工具仍然是一个悬而未决的问题，因此本研究计划将解决两个主要问题，这将是并行研究：a）硬件和软件基础设施如何支持这种新系统的创建，探索和迭代开发，以及B）如何设计和评估数字系统和接口，以支持个人专家从业者的创造性实践？这些基础设施将不会区分设计者和最终用户，而是使用户能够不断适应和重新设计他们的工具。第一个研究问题将探索模块化，开源软件原型工具的设计，使用和评估，建立在连接中间件libmapper（参见例如Malloch，Sinclair和Wanderley 2014; 2018）及其支持语言绑定和实用程序的生态系统，如会话管理器，数据记录器和协议桥。这个基地将被用来调查的工具，发现，理解和映射（连接）“有趣的”信号中发现大量的流传感器数据的集合;整合概念的媒体间映射和脚本工具，并比较编程表示的基础上的事件流的上下文中的实时交互性。第二个主题的研究将利用现有的原型工具和研究主题1开发的工具，当它们变得可用时，来创建和评估新的人机界面的功能原型，用于与数字系统的创造性交互。这些界面将根据所涉及的艺术家或创作者的特殊需求进行极端个性化的调整。通过长时间创造性地使用界面进行的评估将比速度或人机工程效率等经验性测量更有价值。

Digital artists, composers, and musicians form a class of extreme users whose demands of their systems include communication of personal style, mood, and expressive intent, and who are willing to spend countless hours both adapting and becoming accustomed to their tools (Mackay 2000). How to best design such tools is still an open question, and so this research program will address two main questions, which will be studied in parallel: a) how can hardware and software infrastructure support the creation, exploration and iterative development of such novel systems, and b) how to design and evaluate digital systems and interfaces for supporting creative practices by individual expert practitioners?. These infrastructures will not discriminate between designers and end-users, instead enabling users to continuously appropriate and redesign their tools. The first research question will explore the design, use and evaluation of modular, open--source software prototyping tools, building on the connectivity middleware libmapper (see e.g. Malloch, Sinclair, and Wanderley 2014; 2018) and its supporting ecosystem of language bindings and utilities such as session managers, data recorders, and protocol bridges. This base will be used to investigate tools for discovering, understanding and mapping (connecting) "interesting" signals found within large collections of streaming sensor data; integrating concepts from intermedia mapping and scripting tools, and comparing programming representations based on events to those based on streams in the context of live interactivity. Research on the second theme will make use of existing prototyping tools-and those developed by research theme 1 as they become available-to create and evaluate functional prototypes of novel human--computer interfaces for creative interaction with digital systems. These interfaces will be adapted for extreme personalisation to the idiosyncratic needs of the artist(s) or creator(s) involved. Evaluation through prolonged creative use of the interfaces will be valued more heavily than empirical measurements of e.g. speed or ergonomic efficiency.