Embodied Interaction Design for Articulation Elicitation and Feedback

越来越多的计算机科学毕业生，作为他们就业的一部分，将成为协作团队的成员，负责开发交互式系统。数字媒体和软件创作工具的日益普及意味着交互式系统正在为各种新领域和应用开发。设计一个有效实现其目标的交互系统的过程（例如提供某种类型的用户体验或支持学习）需要多学科的技能和能力。这些系统逐渐超越鼠标和键盘的交互，并使用手势或全身交互（使用基于传感器的输入）。这类系统的开发需要具体化交互的专门知识。此外，这样的系统通常是迭代开发的，在中间阶段强烈依赖于形成性的、经验性的用户评价，因此需要关于评价方法的专门知识。本研究计划将调查发音反馈系统的可用性如何受到以下因素的影响：(1)使用比喻性的，而不是真实的，声道的视觉表现；(2)图形视角。图形化视角指的是显示可视化的视角（例如，从虚拟世界代理具有的具身视角或从非具身且更具包容性的视角）。我们将研究可用性的几个方面，包括任务结果（有效性），完成任务结果所需的努力（效率），以及用户体验的质量，如满意度和享受。我们将重点关注老年用户。在进行这项工作时，我们将开发多种新的交互式系统变体，这些系统将使用电磁发音术，以便在语音产生过程中实时跟踪用户的舌头位置。这项工作将强调迭代设计和正在进行的经验测试和评估的重要性。

An increasing number of computer science graduates, as part of their employment, will become members of collaborative teams that are tasked with the development of interactive systems. The increasing accessibility of tools for digital media and software creation means that interactive systems are being developed for a variety of new domains and applications. The process of designing an interactive system that effectively accomplishes its objectives (such as to provide a certain type of user experience or to support learning) requires a multi-disciplinary repertoire of skills and capabilities. Increasingly, these systems go beyond mouse-and-keyboard interaction and use gestural or whole-body interaction (using sensor-based input). The development of such systems requires specialized knowledge about embodied interaction. In addition, such systems are most often developed iteratively, with a strong reliance on formative, empirical user evaluation at intermediate phases, and thus require specialized knowledge about evaluation methodologies.This program of research will investigate how the usability of articulation feedback systems is impacted by (1) the use of metaphorical, as opposed to realistic, visual representations of the vocal tract and (2) graphical perspective. Graphical perspective refers to the point of view with which a visualization is shown (such as from the embodied point of view that an in-world agent has or from a disembodied and more encompassing point of view). We will examine several aspects of usability, including the task outcome (effectiveness), the effort required to accomplish task outcomes (efficiency), and qualities of user experience, such as satisfaction and enjoyment. We will focus on users who are older adults. In undertaking this work, we will develop multiple new variants of interactive systems that will use electromagnetic articulography in order to track in real-time the user's tongue position during the production of speech sounds. This work will emphasize the importance of iterative design and on-going empirical testing and evaluation.