The New Computer Adaptive Test of Size and Strength (CATSS): Development and Validation
The New Computer Adaptive Test of Size and Strength (CATSS): Development and Validation
复制标题
新的尺寸和强度计算机自适应测试 (CATSS)：开发和验证
DOI：
10.1080/15434303.2019.1649409
复制
发表时间：
2019
影响因子：
2.9
通讯作者：
Zahava Goldstein
中科院分区：
文献类型：
--
作者：
Tami Aviad;B. Laufer;Zahava Goldstein
摘要本文描述了新的CATSS(计算机自适应大小和强度测验)的开发和验证，它以四种方式测量词汇知识-产出性回忆、接受性回忆、产生性再认和接受性再认。在论文的第一部分，我们提出了作为测试基础的假设-形式-意义联系的重要性，以及隐含衡量的四个知识程度的概念。在论文的第二部分，我们从题型选择、测试形式、评分以及对学习者的反馈等方面介绍了该测试的核心特点。论文的第三部分描述了对453名三个英语水平的学生进行测试验证的过程。我们采用了基于论证的方法进行验证，并进行了Rasch分析、Cronbach‘s Alpha以及多组ANOVA和Post-hoc检验。这些分析的结果表明，评分系统的稳定性、敏感性和充分性，分数的潜在概括性，分数作为学习者熟练程度和预期词汇量的指标的外推，以及在进行安置考虑或评估进步时使用该测试的可能性。
ABSTRACT This article describes the development and validation of the new CATSS (Computer Adaptive Test of Size and Strength), which measures vocabulary knowledge in four modalities – productive recall, receptive recall, productive recognition, and receptive recognition. In the first part of the paper we present the assumptions that underlie the test – the importance of form-meaning link and the concept of four degrees of knowledge that are implicationally scaled. In the second part of the paper we present the core features of the test in terms of item selection, test format, scoring, and feedback to learners. The third part of the paper describes the process of test validation with 453 students of three English proficiency levels. We adopted the argument-based approach to validation and performed Rasch analyses, Cronbach’s alpha, and multiple sets of ANOVAs and Post-hoc tests. The results of these analyses demonstrate the stability, sensitivity, and adequacy of the scoring system, the potential generalizability of the scores, the extrapolation of the scores as indicators of learners’ proficiency level and expected vocabulary sizes and the possibility of using the test when making placement considerations or assessing progress.