Message Understanding Conference (MUC) Tests of Discourse Processing
Message Understanding Conference (MUC) Tests of Discourse Processing
复制标题
DOI：
--
复制
发表时间：
1995
期刊：
影响因子：
--
通讯作者：
Nancy A. Chinchor;B. Sundheim
中科院分区：
文献类型：
--
作者：
Nancy A. Chinchor;B. Sundheim
已经设计和进行了自然资源规划系统的绩效评价，要求系统提取关于事件和实体的某些预先规定的信息。单个文本可以描述多个事件和实体，评估任务需要系统解析引用以产生预期输出。我们描述了一种早期尝试，利用信息提取评估的结果来洞察语篇处理的难度与信息提取任务性能之间的关系。然后，我们讨论即将到来的名词短语共指评估，该评估是独立于任何其他评估任务设计的，目的是在一小部分话语现象上建立一个明确的性能基准。
Performance evaluations of NLP systems have been designed and conducted that require systems to extract certain prespecified information about events and entities. A single text may describe multiple events and entities, and the evaluation task requires the system to resolve references to produce the expected output.We describe an early attempt to use the results from an information extraction evaluation to provide insight notice relationship between the difficulty of discourse processing and performance on the information extraction task. We then discuss an upcoming noun phrase coreference evaluation that has been designed independently of any other evaluation task in order to establish a clear performance benchmark on a small set of discourse phenomena.