Collaborative Research: Towards Life-like Computer Interfaces that Learn

这个协作项目，开发和评估逼真的、自然的计算机接口，作为决策支持系统（DSS）背景下智能程序的门户，旨在提供一个自然的接口，支持现实的口头对话、非语言提示和学习能力，以保持其知识的最新和正确。研究目标集中在开发一个基于虚拟形象的界面，使DDS用户可以与之交互。与虚拟化身的交流是通过口头的自然语言，结合手势表情或指向屏幕进行的。系统支持独立于说话人的连续语音输入，作为指定DSS域中的自发对话。健壮的后端,可以智能地应对问题问的DDS用户预计将生成的反应在回复《阿凡达》与现实的音调变化和视觉表达。这项工作通过使用项目官员的模型来创建一个能够回答用户问题并以人类自然的方式做出回应的现实化身，从而开发、原型化和评估所需的用户界面功能。该项目根据收集到的与中心项目相关的信息扩展当前赞助的项目，其中项目官员担任主题专家。最近开发的AlexDSS系统可以回答用户关于I/UCRC计划的问题，为虚拟化身提供基础智能系统。头像界面既针对一般用户，也针对负责更新/纠正其中的领域知识的专家。这项工作是UCF智能系统实验室（ISL）和ucic电子可视化实验室（EVL）之间的合作项目。EVL团队专注于虚拟形象的开发，包括与现实虚拟形象的可视化和交互，以及系统自然性和可用性的评估。ISL团队专注于自然语言识别和自动化知识更新和细化。

This collaborative project, developing and evaluating lifelike, natural computer interfaces as portals to intelligent programs in the context of Decision Support System (DSS), aims at providing a natural interface that supports realistic spoken dialog, non-verbal cues, and the capability of learning to maintain its knowledge current and correct. The research objectives focus around the development of an avatar-based interface with which the DDS user can interact. Communication with the avatar takes place in spoken natural language combined with gesture expressions or by pointing on the screen. The system supports speaker-independent continuous speech input as a spontaneous dialog within the specified DSS domain. A robust backend that can respond intelligently to the questions asked by the DDS user is expected to generate the responses spoken in reply by the avatar with realistic inflection and visual expressions.The work develops, prototypes, and evaluates the desired user interface capabilities by using the model of a program officer to create a realistic avatar that can answer users' questions and respond in a humanly natural manner. The project extends a current sponsored project on information gathered related to a centers program where a program officer serves as subject matter expert. The recently-developed AlexDSS system that answers questions to users about the I/UCRC program provides the baseline intelligent system behind the avatar. The avatar interfaces are targeted for both general users as well as for experts responsible for updating/correcting the domain knowledge therein.The work represents a collaborative project between the Intelligent Systems Laboratory (ISL) at UCF and the Electronic Visualization Laboratory (EVL) at UIC. The EVL team focuses on avatar development encompassing Visualization and Interaction with Realistic Avatars and Evaluation of System Naturalness and Usability. The ISL team concentrates on Natural Language Recognition and on Automated Knowledge Update and Refinement.