The Advanced Placement Course Redesign Effort: A Time-Critical Analysis of Assessment Development Processes and Outcomes

这一快速提案建立在重新设计AP科学课程框架的先前工作的基础上，并建议利用教育考试服务(ETS)将于2009年9月至2010年8月提供的新数据来源。ETS目前正在根据重新设计的流程试行新的评估。该项目测试为创建新的AP理科考试而启动的评估开发过程的质量。新的评估遵循新的以证据为中心的设计方法(ECD)，其特点是测试项目和任务与内容域模型保持一致。每门课程的领域模型包括：(1)科学实践的认知模型，(2)内容提纲，(3)成就水平描述，(4)主张和证据陈述。这项研究将测试在任务和项目开发的最后阶段如何忠实地执行ECD过程。PI将对项目规格进行审查，审查生物和化学试题的草稿，审查试点测试的经验数据，与ETS和大学理事会的工作人员进行访谈，并与学生就测试项目进行认知实验室方案。

This RAPID proposal builds on prior work to re-design the frameworks for AP science courses and proposes to capitalize on new sources of data that will be available from the Educational Testing Service (ETS) September 2009-August 2010. ETS is now piloting new assessments based on the re-design process. This project tests the quality of the assessment development processes that have been set in motion for creating new AP science exams. The new assessments follow a new evidence centered design approach (ECD) that is characterized by the alignment of the test items and tasks with the content domain models. The domain models for each course include: (1) a cognitive model of science practices, (2) a content outline, (3) achievement level descriptions, and (4) claims and evidence statements. The research will test how faithfully an ECD process can be executed with respect to the final phases of task and item development.The PI will conduct a review of the item specifications, review the draft biology and chemistry items, examine empirical data from the pilot tests, conduct interviews with the ETS and College Board staff members, and conduct cognitive laboratory protocols on the test items with students.