Interactive Multimodal Interfaces: Designing for Human Performance

* 9530666 Oviatt这项研究为开发包含人类语言技术的多模态/多媒体系统提供了基础，这些系统具有更强大、灵活、可访问和以用户为中心的界面。 具体目标包括：（1）在错误解决过程中对用户的适应语言进行建模，并将此信息应用于更好的错误避免和解决技术的设计，（2）检查复杂视觉显示的不同类型和质量对交互系统的用户语言输入的影响，并设计有效但透明地引导用户输入以匹配系统处理能力的界面，以及（3）开发一种精确的认知工作负荷度量，可以应用于设计集成良好的多模式界面。 为了实现这些目标，正在使用一种快速的半自动模拟技术，支持在多模式人机交互过程中收集高保真数据。 这项研究将显着推进的经验，理论和应用基础所需的多模式接口的设计，并将是至关重要的，建立可用的系统，可以成功地在实际的现场设置。 特别是，它可以对提高下一代通信设备和移动的技术在广泛应用中的商业可行性产生重大影响。 ***

*** 9530666 Oviatt A foundation is provided by this research for the development of substantially more robust, flexible, accessible, and user-centered interfaces for multimodal/multimedia systems that incorporate human language technology. Specific objectives include: (1) modeling users' adapted language during error resolution, and applying this information to the design of better error avoidance and resolution techniques, (2) examining the impact of different types and qualities of complex visual display on users' linguistic input to interactive systems, and designing interfaces that effectively but transparently guide users' input to match system processing capabilities, and (3) developing a refined metric of cognitive workload that can be applied to the design of well-integrated multimodal interfaces. To pursue these objectives, a rapid, semi-automatic simulation technique is being used that supports the collection of high-fidelity data during multimodal human-computer interaction. This research will significantly advance the empirical, theoretical, and applied foundations needed for the design of multimodal interfaces, and will be critical to establishing usable systems that can succeed in actual field settings. In particular, it can have a major impact on improving the commercial viability of next-generation communications devices and mobile technology for a wide range of applications. ***