Collaborative Research: Towards Life-like Computer Interfaces that Learn

这个合作项目，开发和评估逼真的，自然的计算机接口作为门户网站的智能程序的决策支持系统（DSS）的背景下，旨在提供一个自然的界面，支持现实的口语对话，非语言提示，学习的能力，以保持其知识的电流和正确的。研究目标集中在开发一个基于化身的界面，DDS用户可以与之进行交互。与化身的通信发生在口头自然语言结合手势表达或通过在屏幕上指向。该系统支持独立于说话人的连续语音输入作为指定DSS域内的自发对话。一个强大的后端，可以智能地回答DDS用户提出的问题，预计将产生的答复说，在答复的化身与现实的拐点和视觉expressions.The工作开发，原型，并评估所需的用户界面功能，通过使用的模型，程序员创建一个现实的化身，可以回答用户的问题，并在一个人性化的自然方式作出反应。该项目扩展了目前赞助的一个项目，该项目收集的信息与一个中心的项目有关，其中一个项目官员担任主题专家。最近开发的AlexDSS系统为用户提供了关于I/UCRC程序的问题，提供了化身背后的基线智能系统。化身界面针对一般用户以及负责更新/校正其中的领域知识的专家。这项工作代表了UCF的智能系统实验室（ISL）和UIC的电子可视化实验室（EVL）之间的合作项目。EVL团队专注于虚拟形象开发，包括可视化和与现实虚拟形象的交互以及系统自然性和可用性的评估。ISL团队专注于自然语言识别和自动知识更新和优化。

This collaborative project, developing and evaluating lifelike, natural computer interfaces as portals to intelligent programs in the context of Decision Support System (DSS), aims at providing a natural interface that supports realistic spoken dialog, non-verbal cues, and the capability of learning to maintain its knowledge current and correct. The research objectives focus around the development of an avatar-based interface with which the DDS user can interact. Communication with the avatar takes place in spoken natural language combined with gesture expressions or by pointing on the screen. The system supports speaker-independent continuous speech input as a spontaneous dialog within the specified DSS domain. A robust backend that can respond intelligently to the questions asked by the DDS user is expected to generate the responses spoken in reply by the avatar with realistic inflection and visual expressions.The work develops, prototypes, and evaluates the desired user interface capabilities by using the model of a program officer to create a realistic avatar that can answer users' questions and respond in a humanly natural manner. The project extends a current sponsored project on information gathered related to a centers program where a program officer serves as subject matter expert. The recently-developed AlexDSS system that answers questions to users about the I/UCRC program provides the baseline intelligent system behind the avatar. The avatar interfaces are targeted for both general users as well as for experts responsible for updating/correcting the domain knowledge therein.The work represents a collaborative project between the Intelligent Systems Laboratory (ISL) at UCF and the Electronic Visualization Laboratory (EVL) at UIC. The EVL team focuses on avatar development encompassing Visualization and Interaction with Realistic Avatars and Evaluation of System Naturalness and Usability. The ISL team concentrates on Natural Language Recognition and on Automated Knowledge Update and Refinement.