CI-NEW: Collaborative Research: DialPort: Enabling Spoken Dialog Research with Real Data

CI-NEW：协作研究：DialPort：利用真实数据进行口语对话研究

• 批准号: 1512973
• 负责人: Maxine Eskenazi
• 金额: $ 55万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2019-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1512973&HistoricalAwards=false
• 关键词: CI; NEW; Collaborative; Research; DialPort

New interest in spoken dialog research has recently been generated by the advent of SIRI(TM). This application ignited the imagination of many who have begun to believe that speaking to automatic assistants is possible and useful. Soon everyone will need to use speech to communicate with technology, such as smart watches, which can't use a keyboard. Using speech will also give wider access to technology, for example to the elderly and the disabled. It will serve as an economic motivator, spurring new technology and technology-based products. The vision of the Dialog Portal project and community infrrastructure, DialPort, is that it will serve the spoken dialog community by being a central portal that will attract real users to existing dialog systems while also sparking the creation of new streams of spoken dialog data. It will distribute data and software and educate researchers about both, thus making it easier for new colleagues to access this domain. DialPort will link high school and undergraduate students (who have lived with the technology all of their lives, and can imagine how they would like to talk to technology), with technology experts who can help them implement their ideas. DialPort will enable the spoken dialog community to access an unprecedented amount of speech data, which is essential in creating successful dialog systems, as it is used to retrain them (adding data makes the statistical representations more precise) and to assess them (comparing systems helps find which novel techniques improve the systems) and to create new ones. In this manner, the contribution of DialPort will lead to both higher quality research and to widespread use of speech technology. The overarching goal of the DialPort project and community infrastructure is providing real users' speech in many different domains that will generate data and research platforms for the community. As a central portal it will attract the real users to spoken dialog systems that are linked to it. DialPort will relate high school and undergraduate students' ideas for novel, transformational applications of speech technology with the current spoken dialog community's technology. The resulting real applications will provide the streams of data from real users who are interested in repeatedly using an application because it helps them in some way (solving some task, or entertaining them). This will allow researchers to make their systems more robust. DialPort will also provide access to spoken dialog software and data and educate members of the community in their use.Unsolved basic research issues in spoken dialog include: signal processing in noise, recognition of groups of "difficult" users (like the elderly and non-native speakers), management of complex dialogs (i.e. in meetings and with agents), and the automatic use of meta-linguistic information such as prosody. DialPort will spark new applications that can be used as research platforms where these and other issues can be explored. One such platform has been provided in the past for bus information in Pittsburgh. Since then, research has evolved, necessitating real dialog systems in more challenging areas and on more devices. One site cannot create and run all of them. DialPort will help the community to create these systems, insuring that they meet their needs and obtaining consensus on a unified infrastructure. The DialPort project includes: (1) providing a central portal where real users can go to be connected to many spoken dialog systems, thus generating large amounts of real user speech; (2) conducting the yearly REAL Challenge to spark ideas for ways that speech will be used in the future, addressing high school and undergraduate students and educating them about spoken dialog systems; and (3) gathering tools that the community can use, ensuring their documentation and teaching researchers about their use.

最近，随着Siri(TM)的出现，人们对口语对话研究产生了新的兴趣。这款应用激发了许多人的想象力，他们开始相信与自动助理交谈是可能的，也是有用的。很快，每个人都将需要使用语音与智能手表等不能使用键盘的技术进行交流。使用语音还将使更多的人获得技术，例如老年人和残疾人。它将作为经济动力，刺激新技术和以技术为基础的产品。对话门户项目和社区基础设施DialPort的愿景是，它将成为一个中央门户，将吸引真正的用户到现有的对话系统，同时还引发新的口头对话数据流的创建，从而服务于口语对话社区。它将分发数据和软件，并对研究人员进行这两方面的教育，从而使新同事更容易访问这一领域。DialPort将把高中生和本科生(他们一生都与技术生活在一起，可以想象他们想要如何与技术交谈)与能够帮助他们实施想法的技术专家联系起来。DialPort将使口语对话社区能够访问前所未有的语音数据，这对于创建成功的对话系统至关重要，因为它被用于对它们进行再培训(添加数据使统计表示更准确)和评估它们(比较系统有助于发现哪些新技术改进了系统)和创建新的系统。通过这种方式，DialPort的贡献将导致更高质量的研究和语音技术的广泛使用。DialPort项目和社区基础设施的总体目标是在许多不同的领域提供真实的用户发言，为社区生成数据和研究平台。作为一个中央门户，它将吸引真正的用户使用与其链接的口语对话系统。DialPort将把高中生和本科生对语音技术的新颖、变革性应用的想法与当前口语对话社区的技术联系起来。生成的真实应用程序将提供来自真实用户的数据流，这些用户对重复使用某个应用程序感兴趣，因为这在某种程度上对他们有帮助(解决某些任务或娱乐他们)。这将使研究人员能够使他们的系统更加健壮。DialPort还将提供对口语对话软件和数据的访问，并教育社区成员使用这些软件和数据。口语对话中尚未解决的基本研究问题包括：噪音中的信号处理，识别“困难”用户组(如老年人和非母语人士)，管理复杂的对话(如在会议和与代理人的对话中)，以及自动使用元语言信息，如韵律。DialPort将催生新的应用程序，这些应用程序可以用作研究平台，在那里可以探索这些和其他问题。匹兹堡过去曾提供过一个这样的平台来提供公交车信息。从那时起，研究不断发展，需要在更具挑战性的领域和更多的设备上使用真正的对话系统。一个站点不可能创建并运行所有这些应用程序。DialPort将帮助社区创建这些系统，确保它们满足他们的需求，并就统一的基础设施达成共识。DialPort项目包括：(1)提供一个中央门户，真正的用户可以在其中连接到许多口语对话系统，从而生成大量真实的用户语音；(2)开展年度真实挑战，激发关于语音未来使用方式的想法，面向高中生和本科生，并对他们进行口语对话系统的教育；(3)收集社区可以使用的工具，确保他们的文档，并向研究人员传授他们的用法。