Development and Evaluation of Adaptive Computer-Based Test for Students with Disabilities in the National Center Test for University Admissions

国家大学招生中心残疾学生适应性机考的开发与评价

• 批准号: 12480047
• 负责人: FUJIYOSHI Mamoru
• 金额: $ 10.5万
• 依托单位: The National Center for University Entrance Examinations (2001-2002)National Center Test for University Admissions (2000)
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2000
• 资助国家: 日本
• 起止时间: 2000 至 2002
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-12480047/
• 关键词: students with disability; braille format test; large print formfat test; the Center Test for University Entrance Admission; computerized adaptive test; item response theory; 項目応答理論; ユーザ・インターフェース; ペン・コンピュータ; 項目プール

We developed a prototype of an adaptive computer-based test (CBT), which can be measured more effectively and promptly than ordinal paper-and-pencil test (PPT), in order to make fundamental changes of the methods of exams for students with disabilities such as the National Center Test for University Admissions (NCT).As a result of quantitative and tentative study to analyze the ratio of extension of time of the NCT for students with disabilities, we found the necessity of extension of time for the subjects that consist of a large amount of reading materials such as Japanese. It is, however, difficult to extend testing time of NCT since it has already spanned two days. We also found the fact that we could compare the result of linear CBT and ordinal PPT through our experiments. On the basis of this result we studied adaptive CBT so as to improve the methods of test fundamentally.We advanced the development of the CBT system with the user interface to fit the types and extensions of disa … More bilities. For test-takers with severe visual disabilities, we automatically print and set a braille format test including decoding figures. We request test-takers to mark electrical answer sheets for computer scoring on a braille display. For the partially sighted, we studied the most suitable font type and size to display large print format tests in the use of pen computers. We revealed that digital audio format tests can work on the newly blind and students with learning disabilities who have difficulty with character reading.We pursued the construction of an item pool of the CBT with the use of past tests of NCT. We investigated the way to convert the past tests of three subjects, Japanese, mathematics, and English, to XML format text files. We analyzed the past result files with item response theory (IRT) and estimated the differences of difficulty among questions in each year. We collected about 120 freshmen for equating the difference among the operating years of NCT. As each section includes several questions in NCT, we carried out study of IRT for system of testlet.We will study the operation of the CBT in days ahead. The assessment of the availability of comparison between the result of adaptive CBT and PPT also remains to be experimented. Less

为了从根本上改变国家大学招生中心考试（NCT）等残疾学生的考试方法，我们开发了比普通纸笔考试（PPT）更有效、更及时地测量的自适应机考（CBT）原型。通过对残疾学生NCT延长时间比例进行定量和初步研究，我们发现： 对于日语等阅读材料较多的科目，需要延长时间。但NCT的测试时间已经跨越了两天，想要延长测试时间是很困难的。我们还发现，通过实验我们可以比较线性 CBT 和有序 PPT 的结果。在此基础上，我们研究了自适应CBT，从根本上改进了测试方法。我们推进了CBT系统的开发，其用户界面适应了不同能力的类型和扩展。对于有严重视力障碍的考生，我们会自动打印并设置盲文格式测试，包括解码数字。我们要求考生在盲文显示器上标记电子答卷，以便计算机评分。针对弱视人士，我们研究了最适合显示大字体格式的字体类型和大小，并进行了笔式电脑使用测试。我们发现数字音频格式测试可以对新盲人和有学习障碍的汉字阅读困难的学生起作用。我们利用NCT过去的测试来构建CBT的项目库。我们研究了如何将日语、数学和英语三个科目的过去测试转换为 XML 格式的文本文件。我们利用项目反应理论（IRT）分析了过去的成绩档案，并估计了每年试题难度的差异。我们收集了大约120名新生来比较NCT运营年限的差异。由于每个部分都包含NCT中的几个问题，我们对testlet系统进行了IRT的研究。我们将在未来几天研究CBT的操作。自适应 CBT 和 PPT 的结果之间的比较可用性的评估还有待试验。较少的

项目成果

Fujiyoshi, M., Fujiyoshi, A.: "Estimating Testing Time Extension Ratios for Students with Disabilities from Item Cumulative Curves"New Developments in Psychometrics, Proceedings of the International Meeting of the Psychometric Society. IMPS2001. 265-272 (

Fujiyoshi, M., Fujiyoshi, A.：“根据项目累积曲线估算残疾学生的测试时间延长比率”心理测量学的新发展，心理测量学会国际会议论文集。

藤芳衛: "紙と鉛筆のテストの解答過程を研究するため開発したコンピューターベースト・テストの評価"大学入試フォーラム. No.22. 101-102 (2000)

藤吉：“为研究纸笔考试的作答过程而开发的基于计算机的测试的评估”，《大学入学考试论坛》第 22 期。101-102（2000 年）。

藤芳衛: "平成9〜11年度特殊教育諸学校の教育課程と大学進学状況に関する調査報告書 共同研究II「大学受験者の学力多様化に対応する入学者選抜方法の検討」報告書別冊"大学入試センター. 147 (2000)

藤芳江：《1997年至1997年特殊教育学校课程设置及大学招生现状报告。联合研究二：针对大学申请者学术能力多样化的入学选拔方法的审查》，报告补充。大学招生中心。147（2000）

Fujiyoshi, M., Fujiyoshi, A., Ishizuka, T.: "Comparability of Paper-and-Pencil Tests and Computer-Based Tests in Terms of Distributions of Completion Time and Score"The National Center for University Entrance Examinations Research Bulletin. 第30号. 67-82 (2

Fujiyoshi, M.、Fujiyoshi, A.、Ishizuka, T.：“纸笔考试和机考在完成时间和分数分布方面的可比性”国家大学入学考试研究中心公告第 1 号。 30. 67-82 (2

藤芳 衛: "弱視受験生に対する拡大文字問題の表示方法-文字フォントと文字サイズの改善-"日本特殊教育学会第40回大会発表論文集. 670 (2002)

Mamoru Fujiyoshi：“如何为弱视学生显示放大的文本问题 - 改进文本字体和大小 -”日本特殊教育学会第 40 届年会记录 670 (2002)。