Embodied Interaction Design for Articulation Elicitation and Feedback

越来越多的计算机科学毕业生，作为他们就业的一部分，将成为负责开发交互式系统的协作团队的成员。数字媒体和软件创作工具的日益普及意味着正在为各种新的领域和应用开发交互式系统。设计一个有效实现其目标（如提供某种类型的用户体验或支持学习）的交互式系统的过程需要多学科的技能和能力。这些系统越来越多地超越鼠标和键盘交互，并使用手势或全身交互（使用基于传感器的输入）。这种系统的开发需要有关具体互动的专业知识。此外，这种系统通常是迭代开发的，在中间阶段强烈依赖于形成性的、经验性的用户评估，因此需要关于评估方法的专业知识。本研究计划将调查发音反馈系统的可用性如何受到以下因素的影响：（1）使用隐喻，而不是现实，声道的视觉表示和（2）图形透视。图形视角是指显示可视化的视角（例如从现实世界中的代理所具有的具体视角或从非具体和更包容的视角）。我们将研究可用性的几个方面，包括任务结果（有效性），完成任务结果所需的努力（效率），以及用户体验的质量，如满意度和享受。我们将专注于老年人的用户。在进行这项工作时，我们将开发多个新的交互式系统变体，这些系统将使用电磁关节造影术，以便在语音产生过程中实时跟踪用户的舌头位置。这项工作将强调迭代设计和正在进行的实证测试和评估的重要性。

An increasing number of computer science graduates, as part of their employment, will become members of collaborative teams that are tasked with the development of interactive systems. The increasing accessibility of tools for digital media and software creation means that interactive systems are being developed for a variety of new domains and applications. The process of designing an interactive system that effectively accomplishes its objectives (such as to provide a certain type of user experience or to support learning) requires a multi-disciplinary repertoire of skills and capabilities. Increasingly, these systems go beyond mouse-and-keyboard interaction and use gestural or whole-body interaction (using sensor-based input). The development of such systems requires specialized knowledge about embodied interaction. In addition, such systems are most often developed iteratively, with a strong reliance on formative, empirical user evaluation at intermediate phases, and thus require specialized knowledge about evaluation methodologies.This program of research will investigate how the usability of articulation feedback systems is impacted by (1) the use of metaphorical, as opposed to realistic, visual representations of the vocal tract and (2) graphical perspective. Graphical perspective refers to the point of view with which a visualization is shown (such as from the embodied point of view that an in-world agent has or from a disembodied and more encompassing point of view). We will examine several aspects of usability, including the task outcome (effectiveness), the effort required to accomplish task outcomes (efficiency), and qualities of user experience, such as satisfaction and enjoyment. We will focus on users who are older adults. In undertaking this work, we will develop multiple new variants of interactive systems that will use electromagnetic articulography in order to track in real-time the user's tongue position during the production of speech sounds. This work will emphasize the importance of iterative design and on-going empirical testing and evaluation.