Collaborative Research: Adapting IMMEX to Provide Problem Solving Assessment Materials from the ACS Exams Institute

该项目是美国化学学会（ACS）考试研究所、克莱姆森大学和IMMEX项目之间的合作，旨在通过采用IMMEX技术为大学化学头两年开发一种替代评估工具。目标和目的包括以下内容。1. 正在整理和调整内容强调化学结构和功能的综合化学品管理系统案例，以便总结性地评价解决问题的能力，并根据需要设计其他案例，以结构和功能内容基础补充现有案例。2. 对IMMEX中单个案例的动态问题解决行为的分析正在进行调整，以允许跨多个案例和认知测量测量结构和功能认知域。3. 利用项目反应理论分析以及由神经网络和隐马尔可夫模型导出的绩效和进度指标等综合措施，在多个IMMEX案例中建立了结构和功能问题解决比较的内部信度和效度。其中包括学生在动态问题解决状态之间转换的测量标准，以确定学生在大学化学头两年使用成功问题解决策略的收益。4. 目前正在ACS考试所各办事处设立一个远程IMMEX服务器，以提高向日益增多的全国学生提供IMMEX案例的能力。5. 目前正在设计一个报告系统，由考试研究所出版，向教师提供报告，说明参加这个项目的学生在成功解决问题策略方面取得的进展。本项目基于先前对使用immex技术评估问题解决能力的研究。基于结构和功能之间的关系，一系列问题正在被开发出来，结果评估数据被用来为个别学生问题解决者开发预测模型。由此产生的学生问题解决行为数据库也为化学教育者提供了资源。更广泛的影响该项目涉及将新的评估技术推广到全国人口。由此产生的可靠、规范的评估来自一个值得信赖的来源（美国考试协会），侧重于解决问题的更深层次，将提供给更广泛的受众。这些工具的可用性有望促进强调深度学习和解决问题的改革课程的传播。

This project is a collaboration between the American Chemical Society (ACS) Examinations Institute, Clemson University and the IMMEX project, to develop an alternate assessment instrument for the first two years of college chemistry by adapting IMMEX technology. The goals and objectives consist of the following. 1. IMMEX cases with content emphasis on chemical structure and function are being collated and adapted for summative problem solving assessment, and additional cases are being devised as needed to complement current cases with structure and function content bases. 2. Analysis of dynamic problem solving behavior for individual cases within IMMEX is being adapted to allow the measurement of the structure and function cognitive domain across several cases, and cognitive measures. 3. The internal reliability and validity of the comparison of structure and function problem solving is being established across multiple IMMEX cases using a combination of measures including Item Response Theory analysis as well as performance and progress measures derived by neural network and hidden Markov modeling. These include measurement rubrics for transitionsbetween dynamic problem solving states for students to determine gains in the useof successful problem solving strategies for students in the first two years of college chemistry. 4. A remote IMMEX server is being established at the offices of the ACS Examinations Institute to enhance the ability to provide IMMEX cases to a growing national pool of students. 5. A reporting system is being devised that will be published from the Exams Institute to provide instructors with reports of the gains in successful problem solving strategies for their students participating in this project.Intellectual meritThis project is grounded in the prior research on assessment of problem solving usingIMMEX technologies. A range of problems, based on the relationship between structureand function, is being developed and the resulting assessment data are being used to develop predictive models for individual student problem solvers. The resultant database of student problem solving behavior also provides a resource for chemical educators.Broader ImpactThis project involves the extension of new assessment technologies to a nationalpopulation. The resulting reliable, normed assessments from a trusted source (the ACSExaminations Institute) that focus on deeper aspects of problem solving will be availableto a broader audience. The availability of these instruments is expected to facilitate the spread of reformed curricula that emphasize deep learning and problem solving.