Embodied Interaction Design for Articulation Elicitation and Feedback

作为就业的一部分，越来越多的计算机科学毕业生将成为负责开发交互系统的协作团队的成员。数字媒体和软件创作工具的可及性越来越高，这意味着正在为各种新的领域和应用开发交互系统。设计有效实现其目标(如提供某种类型的用户体验或支持学习)的交互系统的过程需要多学科的技能和能力。这些系统越来越多地超越了鼠标和键盘的交互，使用手势或全身交互(使用基于传感器的输入)。这类系统的开发需要有关具体化交互的专业知识。此外，这类系统通常是迭代开发的，在中间阶段强烈依赖形成性、经验性的用户评估，因此需要评估方法的专业知识。本研究计划将调查发音反馈系统的可用性如何受到(1)声道的隐喻性而不是真实感的视觉表示和(2)图形视角的影响。图形视角指的是显示可视化的视角(例如，从现实世界中的代理所具有的具体化的观点，或者从非具体化的和更全面的观点)。我们将考察可用性的几个方面，包括任务结果(有效性)、完成任务结果所需的努力(效率)以及用户体验的质量，如满意度和享受性。我们将重点关注老年人用户。在开展这项工作时，我们将开发多种新的互动系统，这些系统将使用电磁发音技术，以便在语音产生期间实时跟踪用户的舌头位置。这项工作将强调迭代设计和正在进行的经验测试和评估的重要性。

An increasing number of computer science graduates, as part of their employment, will become members of collaborative teams that are tasked with the development of interactive systems. The increasing accessibility of tools for digital media and software creation means that interactive systems are being developed for a variety of new domains and applications. The process of designing an interactive system that effectively accomplishes its objectives (such as to provide a certain type of user experience or to support learning) requires a multi-disciplinary repertoire of skills and capabilities. Increasingly, these systems go beyond mouse-and-keyboard interaction and use gestural or whole-body interaction (using sensor-based input). The development of such systems requires specialized knowledge about embodied interaction. In addition, such systems are most often developed iteratively, with a strong reliance on formative, empirical user evaluation at intermediate phases, and thus require specialized knowledge about evaluation methodologies.This program of research will investigate how the usability of articulation feedback systems is impacted by (1) the use of metaphorical, as opposed to realistic, visual representations of the vocal tract and (2) graphical perspective. Graphical perspective refers to the point of view with which a visualization is shown (such as from the embodied point of view that an in-world agent has or from a disembodied and more encompassing point of view). We will examine several aspects of usability, including the task outcome (effectiveness), the effort required to accomplish task outcomes (efficiency), and qualities of user experience, such as satisfaction and enjoyment. We will focus on users who are older adults. In undertaking this work, we will develop multiple new variants of interactive systems that will use electromagnetic articulography in order to track in real-time the user's tongue position during the production of speech sounds. This work will emphasize the importance of iterative design and on-going empirical testing and evaluation.