Improving Computerized Adaptive Testing In the United States
改善美国的计算机化自适应测试
基本信息
- 批准号:0241020
- 负责人:
- 金额:$ 18万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2003
- 资助国家:美国
- 起止时间:2003-03-15 至 2006-03-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
While the implementation of computerized adaptive testing (CAT) has many advantages, many issues related to CATs are not well understood. This project will study three specific issues in development and implementation of CAT: (1) compatibility between CAT and "paper and pencil" (P&P) tests, (2) test security and item pool usage, and (3) how to calibrate test items in large quantities efficiently and economically. With respect to compatibility between CAT and "paper and pencil" (P&P) tests, it has been widely reported that some students get much lower scores than they would if an alternative P&P version were given. However, examinees currently required to take Graduate Record Examination (GRE) in the United States, for instance, are not given a choice between the standard P&P version of the tests and the CAT versions. Without effective remedial measures, the credibility of CAT could be significantly undermined. This project proposes to modify the statistical procedure used for CAT item selection by incorporating some advanced analytic techniques. It is expected that the analytic and simulation results will show that weighting likelihood score may alleviate the problem of underestimation. With respect to test security and item pool usage, in current operational CATs, computers tend to select certain types of items too frequently, making item exposure rates quite uneven. This project will show that test security and the underestimation problem discussed in the research on CAT and P&P tests are closely related. It is also expected that the project will show that the alpha-stratified approach proposed by Chang and Ying in 1999 tends to improve both the underestimation and test security. With respect to calibrating test items in large quantities efficiently and economically, administration of CATs requires very large item pools. Fortunately, CAT provides great potential to large-scale calibration during on-line testing. This project will explore the development of on-line calibration in CAT.CAT has become a popular mode of educational assessment in the United States. Examples of large scale CATs include the Graduate Record Examination (GRE), the Graduate Management Admission Test (GMAT), the National Council of State Boards of Nursing, and the Armed Services Vocational Aptitude Battery (ASVAB). Findings from this research project may speed up the process of improvement over current item selection algorithms. Because many CATs are high-stakes examinations, improving their test reliabilities will greatly benefit society.
虽然计算机化自适应测试(CAT)的实施有许多优点,但与CAT相关的许多问题还没有得到很好的理解。 本研究将探讨CAT发展与实施中的三个具体问题:(1)CAT与纸笔测验的相容性;(2)测验的安全性与试题库的使用;(3)如何有效且经济地大量校正试题。 关于CAT和“纸笔”(P P)测试之间的兼容性,据广泛报道,一些学生的分数比他们在另一种P P版本的情况下得到的分数要低得多。 然而,例如,目前需要参加美国研究生入学考试(GRE)的考生无法在标准P P版本的考试和CAT版本之间进行选择。 如果不采取有效的补救措施,《禁止酷刑公约》的可信度可能会受到严重损害。 本计画提出将先进的分析技术应用于电脑辅助测验项目选择的统计程序。 预计分析和模拟结果将表明,加权似然得分可以缓解低估的问题。 关于测试安全性和项目池的使用,在当前的操作CAT中,计算机倾向于过于频繁地选择某些类型的项目,使得项目暴露率非常不均匀。 本项目将表明,CAT和P P测试研究中讨论的低估问题与测试安全性密切相关。 预计该项目将表明,Chang和Ying在1999年提出的α分层方法倾向于改善低估和测试安全性。 关于有效和经济地校准大量测试项目,CAT的管理需要非常大的项目池。 幸运的是,CAT为在线测试期间的大规模校准提供了巨大的潜力。 本研究将探讨电脑辅助教学(CAT)的线上校正发展。CAT在美国已成为一种流行的教育评估模式。 大规模CAT的例子包括研究生入学考试(GRE),研究生管理入学考试(GMAT),国家护理委员会的国家理事会和武装部队职业能力测试(ASVAB)。 从这个研究项目的结果可能会加快目前的项目选择算法的改进过程。 由于许多CAT是高风险的考试,提高其考试的可靠性将大大有利于社会。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Hua-Hua Chang其他文献
Development and techniques in learner model in adaptive e-learning system: A systematic review
自适应电子学习系统中学习者模型的发展与技术:系统综述
- DOI:
10.1016/j.compedu.2024.105184 - 发表时间:
2025-02-01 - 期刊:
- 影响因子:10.500
- 作者:
Xiyu Wang;Yukiko Maeda;Hua-Hua Chang - 通讯作者:
Hua-Hua Chang
Does Standard Deviation Matter? Using “Standard Deviation” to Quantify Security of Multistage Testing
- DOI:
10.1007/s11336-013-9356-y - 发表时间:
2014-01-01 - 期刊:
- 影响因子:3.100
- 作者:
Chun Wang;Yi Zheng;Hua-Hua Chang - 通讯作者:
Hua-Hua Chang
Statistical Foundations for Computerized Adaptive Testing with Response Revision
- DOI:
10.1007/s11336-019-09662-9 - 发表时间:
2019-06-01 - 期刊:
- 影响因子:3.100
- 作者:
Shiyu Wang;Georgios Fellouris;Hua-Hua Chang - 通讯作者:
Hua-Hua Chang
多维计算机化自适应测验中的新在线标定方法开发
- DOI:
- 发表时间:
2017 - 期刊:
- 影响因子:2.6
- 作者:
Ping Chen;Chun Wang;Tao Xin;Hua-Hua Chang - 通讯作者:
Hua-Hua Chang
M.D. RECKASE (2009) Multidimensional Item Response Theory (Statistics for Social and Behavioral Sciences).
- DOI:
10.1007/s11336-011-9212-x - 发表时间:
2011-07-01 - 期刊:
- 影响因子:3.100
- 作者:
Hua-Hua Chang;Chun Wang - 通讯作者:
Chun Wang
Hua-Hua Chang的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Hua-Hua Chang', 18)}}的其他基金
Improving Computerized Adaptive Testing In the United States
改善美国的计算机化自适应测试
- 批准号:
0613025 - 财政年份:2005
- 资助金额:
$ 18万 - 项目类别:
Standard Grant
相似海外基金
A Framework for Fast, Accurate, and Explainable Computerized Adaptive Language Test
快速、准确且可解释的计算机化自适应语言测试框架
- 批准号:
24K20903 - 财政年份:2024
- 资助金额:
$ 18万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
CAREER: Cognitive Diagnosis in E-Learning: A Nonparametric Approach for Computerized Adaptive Testing
职业:电子学习中的认知诊断:计算机自适应测试的非参数方法
- 批准号:
2423762 - 财政年份:2024
- 资助金额:
$ 18万 - 项目类别:
Continuing Grant
The Item Bank Calibration and Replenishment for Computerized Adaptive Testing in Small Scale Assessments: Method, Theory, and Application
小规模评估中计算机化自适应测试的题库校准和补充:方法、理论和应用
- 批准号:
2243044 - 财政年份:2023
- 资助金额:
$ 18万 - 项目类别:
Standard Grant
The development of a computerized adaptive diagnostic grammar test for Japanese university students
针对日本大学生的计算机自适应诊断语法测试的开发
- 批准号:
23K12247 - 财政年份:2023
- 资助金额:
$ 18万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
Developing chained computerized adaptive testing for formative assessment
开发用于形成性评估的链式计算机化自适应测试
- 批准号:
22H01061 - 财政年份:2022
- 资助金额:
$ 18万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
CAREER: Cognitive Diagnosis in E-Learning: A Nonparametric Approach for Computerized Adaptive Testing
职业:电子学习中的认知诊断:计算机自适应测试的非参数方法
- 批准号:
2302406 - 财政年份:2022
- 资助金额:
$ 18万 - 项目类别:
Continuing Grant
Computerized Adaptive Suicidal Risk Stratification and Prediction
计算机化自适应自杀风险分层和预测
- 批准号:
10254382 - 财政年份:2019
- 资助金额:
$ 18万 - 项目类别:
Computerized Adaptive Suicidal Risk Stratification and Prediction
计算机化自适应自杀风险分层和预测
- 批准号:
10611259 - 财政年份:2019
- 资助金额:
$ 18万 - 项目类别:
Computerized Adaptive Business Japanese Test
计算机化自适应商务日语考试
- 批准号:
19H01275 - 财政年份:2019
- 资助金额:
$ 18万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
Computerized Adaptive Suicidal Risk Stratification and Prediction
计算机化自适应自杀风险分层和预测
- 批准号:
10019729 - 财政年份:2019
- 资助金额:
$ 18万 - 项目类别: