Collaborative Research: Towards Life-like Computer Interfaces that Learn

这个合作项目开发和评估逼真的、自然的计算机界面，作为决策支持系统(DSS)中智能程序的门户，旨在提供一个自然的界面，支持真实的口头对话、非语言提示，以及学习保持其知识的最新和正确的能力。研究目标集中在开发一种基于虚拟形象的界面，DDS用户可以与之交互。与化身的交流是通过自然口语结合手势表情或通过在屏幕上指向进行的。该系统支持不依赖于说话者的连续语音输入，作为指定DSS域内的自发对话。一个强大的后端，可以智能地响应DDS用户提出的问题，预计将生成化身以逼真的语调和视觉表达回答的回答。该工作通过使用项目官员的模型来开发、原型和评估所需的用户界面功能，以创建一个能够回答用户问题并以人类自然方式做出回应的真实化身。该项目扩展了目前赞助的一个项目，该项目收集的信息与一名项目官员担任主题专家的中心项目有关。最近开发的AlexDSS系统回答了用户关于I/UCRC计划的问题，提供了化身背后的基线智能系统。虚拟化身界面既面向普通用户，也面向负责更新/更正领域知识的专家。这项工作代表了UCF的智能系统实验室(ISL)和UIC的电子可视化实验室(EVL)之间的合作项目。EVL团队专注于虚拟化身开发，包括可视化和与真实虚拟化身的交互，以及评估系统的自然性和可用性。ISL团队专注于自然语言识别和自动知识更新和提炼。

This collaborative project, developing and evaluating lifelike, natural computer interfaces as portals to intelligent programs in the context of Decision Support System (DSS), aims at providing a natural interface that supports realistic spoken dialog, non-verbal cues, and the capability of learning to maintain its knowledge current and correct. The research objectives focus around the development of an avatar-based interface with which the DDS user can interact. Communication with the avatar takes place in spoken natural language combined with gesture expressions or by pointing on the screen. The system supports speaker-independent continuous speech input as a spontaneous dialog within the specified DSS domain. A robust backend that can respond intelligently to the questions asked by the DDS user is expected to generate the responses spoken in reply by the avatar with realistic inflection and visual expressions.The work develops, prototypes, and evaluates the desired user interface capabilities by using the model of a program officer to create a realistic avatar that can answer users' questions and respond in a humanly natural manner. The project extends a current sponsored project on information gathered related to a centers program where a program officer serves as subject matter expert. The recently-developed AlexDSS system that answers questions to users about the I/UCRC program provides the baseline intelligent system behind the avatar. The avatar interfaces are targeted for both general users as well as for experts responsible for updating/correcting the domain knowledge therein.The work represents a collaborative project between the Intelligent Systems Laboratory (ISL) at UCF and the Electronic Visualization Laboratory (EVL) at UIC. The EVL team focuses on avatar development encompassing Visualization and Interaction with Realistic Avatars and Evaluation of System Naturalness and Usability. The ISL team concentrates on Natural Language Recognition and on Automated Knowledge Update and Refinement.