Automated Pyramid Summarization Evaluation
Automated Pyramid Summarization Evaluation
复制标题
DOI：
10.18653/v1/k19-1038
复制
发表时间：
2019-11
期刊：
影响因子：
--
通讯作者：
Yanjun Gao;Chen Sun;R. Passonneau
中科院分区：
文献类型：
--
作者：
Yanjun Gao;Chen Sun;R. Passonneau
金字塔评估是为了评估源文本段落长度摘要的内容而开发的。金字塔列出在多个参考摘要中找到的不同内容单元，根据内容单元出现在多少参考摘要中对其进行加权，并根据新摘要的加权内容生成三个分数。我们提出了一种自动化的方法，比以前的自动金字塔方法更有效，更透明，更完整。它是在一个新的学生摘要数据集和提取摘要器的历史NIST数据上进行测试的。
Pyramid evaluation was developed to assess the content of paragraph length summaries of source texts. A pyramid lists the distinct units of content found in several reference summaries, weights content units by how many reference summaries they occur in, and produces three scores based on the weighted content of new summaries. We present an automated method that is more efficient, more transparent, and more complete than previous automated pyramid methods. It is tested on a new dataset of student summaries, and historical NIST data from extractive summarizers.