Writing and Talking to Future Interactive Systems

这是三年连续补助金的第一年。 作为 计算朝着小型便携式设备的方向发展， 语音和笔将成为选择输入形式。 这 研究解决了一个关键问题， 结构、语言和性能特点 手写和语音以及使用时它们的相互作用问题 在一个应用程序中。 一系列的主题 实验将评估写作和演讲时，他们是：（1） 通过不同类型的系统提示，（2）解决 典型的系统识别错误，以及（3）体验系统 反应延迟的程度和可预测性。 这 研究将提供一个更完整的了解，人们如何 我将撰写和发言，以未来的互动系统，以及如何这 可以通过系统交互性的基本参数来改变。 它还将为设计 复杂的多模式系统。//

This is the first year of a three year continuing grant. As computing moves in the direction of small portable devices, speech and pen will become input modalities of choice. This research addresses a critical issue of the identification of the structural, linguistic and performance characteristics of handwriting and speech and issues of their interaction when used together in an application. A series of subject-placed experiments will assess writing and speech when they are: (1) channeled by different types of system prompts, (2) resolving typical system recognition errors, and (3) experiencing system response delays deferring in magnitude and predictability. This research will provide a more complete understanding of how people will write and speak to future interactive systems and how this can be altered by fundamental parameters of system interactivity. It will also provide a more principled basis for the design of complex multimodal systems.//