Developing an Analytic Rating Scale for L2 Summary Writing in the Japanese University Context

点击翻译按钮获取中文摘要

The overall purpose of our project is to provide an analytic rating scale for L2 summary writing in the Japanese university context. Although Educational Testing Service (ETS) has developed a holistic scale, it is hard to identify whether a writer merely failed in reading comprehension or had difficulty in writing even if he or she understood the passage.We have found that using the ETS scale led to lower reliability among Japanese raters, who are English as a foreign language (EFL) teachers, than among native English raters in evaluating summaries written by Japanese university students. Therefore, we have developed an analytic rating scale that reflects opinions from the Japanese raters, after which experts in language testing were asked to join the expert judgment. This analytic scale has five aspects: content, paraphrase (quantity), paraphrase (quality) and language use, and overall quality.