Research and Development of Programs for Teacher Training to Improve Reliability in Evaluation

研究的重点是寻求提高作文评价的信度的措施。为了评价作文的目的，欧洲和美国已经发展出了作为评价标准的量表。据介绍，将相同的题目提供给老师和学生不仅提高了作文的质量，还保证了一定程度的评价一致性。然而，这种方法并不是没有问题。这是因为标准本身并不总是确保始终保持一致的客观评价。在美国，有一种名为SAT的测试，它对大学的录取率有很大的影响。从2005年开始，SAT考试被修改为包括一篇论文。研究人员调查了为提高这些论文的评价可靠性而采取的各种措施。此外，研究人员查看了国际文凭组织的文凭计划，并选择了组成部分TOK(知识论)，它要求学生写大量的论文，以调查为这些论文选择的任务和主题，论文写作要求和评估这些论文的方法。作为日本评估人员培训的先决条件，我们认为上述调查可以作为参考，以准备什么样的资源，以及在培训中使用什么样的程序，以便评估人员能够进行一致的客观评估。为了提供成功融入培训的例子，NWREL的文章《沟通的问题：课堂教学和评估E.A.R.口语交际特质的练习册》被翻译并作为参考材料包括在内。

Research was carried out focused on seeking measures to improve reliability in essay evaluation.For the purpose of evaluating essays, the rubric has been developed in Europe and America as a yardstick for evaluation. According to reports, not only does making the same rubric available to both teachers and students improve the quality of the essay, it also ensures a certain degree of consistency in evaluation. However, this approach is not devoid of problems. This is because a rubric itself does not always ensure objective evaluation that is consistent throughout. It is therefore important for evaluators who utilize rubrics as part of evaluation to receive training.In the United States, there is a test called the SAT, which has a major influence on university acceptance. From 2005 the SAT has been revised to include an essay. The researcher investigated the kinds of measures taken to improve reliability of evaluation for these essays. Additionally, the researcher looked at the diploma program of the International Baccalaureate Organization and chose the component TOK (Theory of Knowledge), which requires its students to write large volumes of essays, to investigate the kinds of tasks and themes chosen for these essays, the essay writing requirements and the method by which these essays were evaluated.As an antecedent to training of evaluators in Japan, we believe that the above investigation serves as a reference to what kind of resources to prepare, and what kind of procedures to use in training so evaluators are equipped to perform objective evaluation that is consistent throughout.To provide examples of what is successfully being incorporated into training, the NWREL essay "Communication Matters : A Workbook for Classroom Instruction and Assessment of the E.A.R. Oral Communication Traits" was translated and included as reference material.