Validating a CEFR-informed Open Access English Placement Test

2022年，课程分班考试经过了稍微修改，时间限制为40分钟。通过Moodle LMS在智能手机上进行测试的247名日本大学生同意将他们的测试结果用于研究目的。与第一个试点一样，Cronbach's alpha为0.9，Rasch person分离统计量为2.91的有力统计证据支持将学生分为三个能力组以进行课程安排的测试功能。然而，项目分析发现，当按CEFR-J词表水平排序时，项目质量和测试项目的排序存在一些问题。因此，在收集标准效度数据和设定标准分数之前，需要进一步修改和创建测试项目。

In 2022 a slightly revised version of the course placement test with a 40-minute time limit was trailed. 247 of the Japanese university students who took the test on their smartphones through the Moodle LMS, gave permission for their test results to be used for research purposes. As with the first pilot, strong statistical evidence from a Cronbach's alpha of 0.9 and a Rasch person separation statistic of 2.91 was found to support the test function of dividing students into three ability groups for course placement purposes. However, item analysis revealed some problems with item quality and with the ordering of test items when ranked by CEFR-J wordlist levels. Therefore, further revision and creation of test items is needed before collecting criterion validity data and setting cut scores.