Developing a web-based rating system for Japanese Oral Proficiency Test as large scale test

点击翻译按钮获取中文摘要

The present study developed the rating system for Japanese Language Oral Proficiency Test. In the system, spoken samples of examinees’ speech were accessed through the Internet. Raters could enter the results for each item shown on ascoring table, which was successively indicated on a PC screen. Rating of each rater was relatively consistent for each domain. Quantitative ratings were relatively more consistent among raters than qualitative ratings. However, some raters gave different quantitative ratings from others. The results of multi-faceted Rasch analysis indicated that dispersion of strictness between raters was significant. The estimates on the ability scale were not significantly different from the assumed ability of the 12 speakers.