CRI:CRD Creation of a Goal-Oriented, Human-Machine Spoken Dialog Corpus and an Infrastructure for Dialog System Evaluation

一套小型人机对话语料库（“微型语料库”）正在转录和注释，并分发给对话领域的研究人员。这些语料库的原始数据已经存在，并且已经使用两个现有系统（AT T实验室的DiSCoH和卡内基梅隆大学的ConQuest）生成。由此产生的语料库正在分发给该领域的研究人员，目的是征求对语料库组成和注释的反馈，这些反馈可以最好地支持人机对话交互领域的研究。当局现正整理这项工作所得的意见，并向社会发放。在与2007年高级别小组/NAACL会议同期举行的一个研讨会上讨论这项工作的成果，为制定一套大规模收集此类数据的准则提供了机会。研讨会的安排方便了对话社区中许多研究人员的出席。此外，NSF的支持使研讨会能够确保来自北美和国际中心的研究人员的广泛参与。在反馈和征求过程中产生的讨论和文件为准备NSF CRI：CRD计划的社区支持提案提供了基础。有系统地收集和附加说明的数据有助于人机对话研究的进展，这反过来又有助于开发更先进和更广泛的信息获取技术。

A set of small-scale human-computer dialogue corpora ("micro-corpora") is being transcribed and annotated, and distributed to researchers in the area of dialogue. The raw data for these corpora already exists and has been generated using two existing system (DiSCoH from AT&T labs and ConQuest from Carnegie Mellon University). The resulting corpora are being distributed to researchers in the field with the goal of soliciting feedback on the corpus composition and annotation that can best support research in the field of human-machine dialogue interaction. Feedback from this exercise is being collated and disseminated back to the community. Discussion on the outcome of this exercise at a workshop collocated with the 2007 HLT/NAACL conference provides the opportunity to develop a set of guidelines for the large scale collection of such data. The workshop collocation makes attendance convenient for many researchers in the dialogue community. In addition, support from NSF allows the workshop to ensure broad participation by researchers from both North America and international centers. Discussions and documents generated in the feedback and solicitation process provide a basis for the preparation of a community-supported proposal to the NSF CRI:CRD program. The availability of systematically collected and annotated data supports progress in human-computer dialogue research which in turn enables the development of more sophisticated and broadly-accessible technologies for information access.