Evaluating computer-based and paper-based versions of an English-language listening test
Evaluating computer-based and paper-based versions of an English-language listening test
复制标题
评估英语听力测试的机考版和纸考版
DOI：
10.1017/s0958344006000425
复制
发表时间：
2006
期刊：
影响因子：
4.5
通讯作者：
David Coniam
中科院分区：
文献类型：
--
作者：
David Coniam
这篇文章描述了一项旨在为香港中学生提供计算机测试材料的英语听力测试，香港正大力发展在线和计算机测试。除了提供以学校为基础的测试设施外，这项研究的目的是促进关于基于计算机的测试的有效性和可靠性的知识库。本文根据项目反应理论构建了一个包含400多个短篇听力试题的题库。来自该库的试题被用来组成传统的纸质听力测试和适应性计算机测试。这两种形式的测试都在香港11年级和12年级的两个班级进行。描述性测试统计表明，两种测试类型都有效地区分了不同的学校年级。在测试类型之间的可比性方面，11年级的班级的表现与12年级的班级表现有显著差异。考生在计算机考试中的表现普遍好于纸质考试，这证实了之前的研究。在参加了这两项考试后对考生的采访显示，在偏好方面，男生选择了电脑考试，而女生选择了纸质考试。考生在这两种测试类型上的表现有很高的相关性，足以显示以电脑为基础的测试作为一项低风险测试的潜力(它作为以学校为基础的测试设施的预期目的)，尽管不是作为一种高风险的测试(例如，作为一项全港性测试取代传统的纸质测试)。
This paper describes an English language listening test intended as computer-based testing material for secondary school students in Hong Kong, where considerable attention is being invested in online and computer-based testing. As well as providing a school-based testing facility, the study aims to contribute to the knowledge base regarding the efficacy and reliability of computer-based testing. The paper describes the construction of an item bank of over 400 short listening items calibrated on item response theory principles. Items from this bank were used to form a traditional paper-based listening test, and an adaptive computer-based test. Both forms of the test were administered to two Hong Kong Grade 11 and Grade 12 classes. Descriptive test statistics indicated that both test types discriminated effectively between school grades. In terms of comparability between test types, there was significant difference between the Grade 11 classes’ performance although not with that of Grade 12. Test takers generally performed better on the computer-based test than on the paper-based test, confirming earlier research. Interviews with test takers after taking both tests indicated an even split in terms of preference, with boys opting for the computer-based test and girls the paper-based test. Correlations between test takers’ performance on the two test types were high enough to indicate the computer-based test’s potential as a low-stakes test (its intended purpose as a school-based testing facility), although not as a high-stakes test (for example, as a territory-wide test replacing a traditional paper-based test).
开发 CBT 英语水平测试
DOI：
--
发表时间：
2005
期刊：
PC Conference 2005
影响因子：
--
作者：
Ishikawa;S.;Nakamura;Y.
通讯作者：
Y.