ITR: Adaptive Spoken Dialog with Human and Computer Partners

ITR：与人类和计算机合作伙伴的自适应口语对话

• 批准号: 0325188
• 负责人: Susan Brennan
• 金额: $ 150万
• 依托单位: SUNY at Stony Brook
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-11-15 至 2008-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0325188&HistoricalAwards=false
• 关键词: ITR; Adaptive; Spoken; Dialog; Human

This project takes an innovative and multidisciplinary approach to characterizing how spoken language production and interpretation are coordinated in dialog. It examines how people adapt to both human and computer conversational partners, through variation in pronunciation (e.g, dialect), rhythm, word choice, sentence structure, and perspective. Adaptations include those that make processing easier for both partners, such as converging on the same wording; they also include adjustments made by one partner "for" the other. Findings from human dialog will be applied to systems that use speech recognition and generation, with the goals of (1) getting users to adapt utterances to forms the system can process more robustly, and (2) whenever feasible, adapting the system's vocabulary, dialect, and perspective to the user's' needs. The project brings together methods and theoretical perspectives from computer science, linguistics and psychology to advance theories and improve applications. Methods include laboratory experiments, corpus studies, and simulation studies, integrated with prototyping and evaluation of spoken dialog systems. Three applications are planned: a picture matching game, a PDA-based calendar system, and a telephone-based course evaluation system for an undergraduate community. The project will enhance training of young scientists in computer science, linguistics and psychology, and will include underrepresented groups in basic research and user-interface engineering. The broader impact will be a scientific foundation for developing flexible and robust spoken dialog systems that serve the needs of diverse users. Specific application opportunities include mobile computing, educational assessment, machine speech recognition of non-standard pronunciation, and tutoring systems for the hearing impaired or second-language learners.

这个项目采用创新和多学科的方法来描述对话中口语的产生和口译是如何协调的。它考察了人们如何通过发音(例如，方言)、节奏、选词、句子结构和视角的变化来适应人类和计算机对话伙伴。调整包括那些使双方更容易处理的调整，例如集中在相同的措辞上；它们还包括一个合作伙伴“为”另一个进行的调整。人类对话的发现将应用于使用语音识别和生成的系统，目标是(1)让用户将话语适应到系统可以更稳健地处理的形式，以及(2)只要可行，就根据用户的需求调整系统的词汇、方言和观点。该项目汇集了计算机科学、语言学和心理学的方法和理论观点，以促进理论和改进应用。方法包括实验室实验、语料库研究和模拟研究，与口语对话系统的原型和评估相结合。计划中有三个应用程序：图片匹配游戏，基于PDA的日历系统，以及面向本科生社区的基于电话的课程评估系统。该项目将加强对年轻科学家在计算机科学、语言学和心理学方面的培训，并将基础研究和用户界面工程中代表性不足的群体包括在内。更广泛的影响将为开发灵活和强大的口语对话系统提供科学基础，以满足不同用户的需求。具体的应用机会包括移动计算、教育评估、非标准发音的机器语音识别，以及为听障或第二语言学习者提供的辅导系统。