STUDIES OF A LATENT-CLASS SIGNAL-DETECTION MODEL FOR CONSTRUCTED-RESPONSE SCORING
STUDIES OF A LATENT-CLASS SIGNAL-DETECTION MODEL FOR CONSTRUCTED-RESPONSE SCORING
复制标题
用于构建反应评分的潜在类信号检测模型的研究
DOI：
--
复制
发表时间：
2008
期刊：
影响因子：
--
通讯作者：
L. T. DeCarlo
中科院分区：
文献类型：
--
作者：
L. T. DeCarlo
在作文评分中，评分员的行为可以被视为一项信号检测任务，因为评分员试图区分潜在的作文类别，潜在的类别由评分标准来定义。本报告考察了通过潜伏级信号检测模型进行构建反应(CR)评分的方法的基本方面。该模型为CR评分提供了一个心理学框架，并包含了具有明确认知基础的评分者参数。模拟被用来检验评分者参数和潜在类大小的恢复情况以及分类的准确性。考察了评分者参数与一致性统计和分类精度的关系。比较了平衡、不完全区组设计与完全交叉设计的效果。该模型被应用于几个ETS数据集。
Rater behavior in essay grading can be viewed as a signal-detection task, in that raters attempt to discriminate between latent classes of essays, with the latent classes being defined by a scoring rubric. The present report examines basic aspects of an approach to constructed-response (CR) scoring via a latent-class signal-detection model. The model provides a psychological framework for CR scoring and includes rater parameters with a clear cognitive basis. Simulations are used to examine how well rater parameters and latent-class sizes are recovered as well as the accuracy of classification. The relation of rater parameters to agreement statistics and classification accuracy is examined. The effects of using a balanced, incomplete block design are compared to those for a fully crossed design. The model is applied to several ETS datasets.
影响因子：
7
作者：
Flora, DB;Curran, PJ
通讯作者：
Curran, PJ