Setting standards on educational tests
Setting standards on educational tests
复制标题
DOI：
10.1046/j.1365-2923.2003.01495.x
复制
发表时间：
2003-05-01
影响因子：
6
通讯作者：
Norcini, JJ
中科院分区：
文献类型：
--
作者：
Norcini, JJ
目的本单元介绍专业评估的方法。方法标准是一个特殊的分数，用来区分表现良好和不好的人。选择标准的具体步骤包括：确定标准的类型;确定制定标准的方法;选择法官;召开会议;计算分界点;以及决定之后的工作。四个更流行的方法说明了书面和临床examination.Results选择一种方法来设定标准的最重要的标准是它是否符合测试的目的，根据专家的判断，由数据告知，支持的研究，透明的，需要尽职调查。标准的可信度将在很大程度上取决于标准制定者的性质，选择一个具有广泛代表性和知识渊博的群体至关重要。标准已经确定后，重要的是要确保利益相关者认为结果是可信的，并通过率有合理的关系与其他标志物的capability.Conclusions一个标准是一种表达的专业价值观的背景下，测试的目的和内容，考生的能力，和更广泛的社会或教育环境。因为标准是价值观的一种表达，所以制定标准的方法是收集价值判断、达成共识并将共识表达为测试中的单一分数的系统方法。
Objective This instalment in the series on professional assessment provides an introduction to methods of setting standards.Method A standard is a special score that serves as a boundary between those who perform well enough and those who do not. The practical steps in selecting it include: deciding on the type of standard; deciding the method for setting it; selecting the judges; holding the meeting; calculating the cutpoint, and deciding what to do afterwards. Four of the more popular methods are illustrated for both written and clinical examinations.Results The most important criteria for selecting a method for setting standards are whether it is consistent with the purpose of the test, based on expert judgement, informed by data, supported by research, transparent, and requires due diligence. The credibility of the standard will rely largely on the nature of the standard setters and the selection of a broadly representative and knowledgeable group is essential. After the standard has been set, it is important to ensure that stakeholders view the results as credible and that the pass rates have sensible relationships with other markers of competence.Conclusions A standard is an expression of professional values in the context of a test's purpose and content, the ability of the examinees, and the wider social or educational setting. Because standards are an expression of values, methods for setting them are systematic ways of gathering value judgements, reaching consensus and expressing that consensus as a single score on a test.