Exploring the Assessment of Summaries: Using Latent Semantic Analysis to Grade Summaries Written by Spanish Students☆
Exploring the Assessment of Summaries: Using Latent Semantic Analysis to Grade Summaries Written by Spanish Students☆
复制标题
探索摘要评估：利用潜在语义分析对西班牙学生撰写的摘要进行评分☆
DOI：
10.1016/j.sbspro.2013.06.029
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
D. Perry
中科院分区：
文献类型：
--
作者：
J. A. León;R. Olmos;Inmaculada Escudero;Guillermo Jorge;D. Perry
在本研究中，我们提出了一种使用LSA自动评估摘要的集成方法。该方法是基于一个回归方程计算的语料库的一百个摘要（训练样本），并验证了不同的样本的摘要（验证样本）。该方程结合了从LSA中提取的两个参数：语义相似度和向量长度。共有来自四个教育阶段的396名学生参加了这项研究。每个参与者写的简短叙述性文本的摘要由四名人类评分员在0-10的量表上进行评估，并将分数与使用LSA的摘要评估进行比较。结果支持，将这两个参数的方法比传统的余弦测量更成功，LSA显示出类似的水平的敏感性，在不同的学术阶段所产生的摘要的质量所示的人类分级。
In this study we propose an integrated method to automatically assess summaries using LSA. The method is based on a regression equation calculated with a corpus of a hundred summaries (the training sample), and is validated on a different sample of summaries (the validation sample). The equation incorporates two parameters extracted from LSA: semantic similarity and vector length. A total of 396 students drawn from four stages of education participated in the study. The summaries of a short narrative text written by each participant were evaluated on a scale of 0-10 by four human graders and the scores compared to the evaluation of the summaries using LSA. The results supported that incorporating both parameters into the method resulted more successful than the traditional cosine measure, and that LSA showed a similar level of sensitivity to the quality of the summaries produced in different academic stages as that shown by the human graders.