Collaborative Research: Adapting IMMEX to Provide Problem Solving Assessment Materials from the ACS Exams Institute

该项目是美国化学学会(ACS)考试研究所、克莱姆森大学和IMMEX项目的合作项目，旨在通过采用IMMEX技术开发一种用于大学化学头两年的替代评价器。这些目标和目的包括以下内容。1.正在整理内容侧重于化学结构和功能的IMMEX案例，并对其进行调整，以便进行总结性问题解决评估，并根据需要设计更多案例，以补充现有案例的结构和功能内容基础。2.正在对IMMEX内个别案例的动态问题解决行为进行分析，以允许跨多个案例测量结构和功能认知域，以及认知测量。3.在多个IMMEX案例中，使用包括项目反应理论分析在内的测量方法以及神经网络和隐马尔可夫模型得出的性能和进度测量方法，建立了结构和功能问题解决比较的内部信度和效度。其中包括学生在动态问题解决状态之间转换的测量标准，以确定学生在大学化学头两年使用成功的问题解决策略的收获。4.目前正在ACS考试研究所的办公室建立一个远程IMMEX服务器，以加强向越来越多的全国学生提供IMMEX案例的能力。5.正在设计一个报告系统，该系统将由考试研究所发布，为教师提供参与该项目的学生在成功解决问题策略方面的收获报告。智力价值该项目基于先前关于使用IMMEX技术评估问题解决的研究。根据结构和功能之间的关系，正在开发一系列问题，所产生的评估数据正被用于为个别学生问题解决者开发预测模型。由此产生的学生问题解决行为数据库也为化学教育工作者提供了资源。广泛影响该项目涉及将新的评估技术扩展到全国人口。由此产生的可靠、规范的评估来自可信的来源(ACS考试研究所)，这些评估侧重于问题解决的更深层次方面，将被更广泛的受众获得。这些工具的提供预计将促进强调深入学习和解决问题的改革课程的传播。

This project is a collaboration between the American Chemical Society (ACS) Examinations Institute, Clemson University and the IMMEX project, to develop an alternate assessment instrument for the first two years of college chemistry by adapting IMMEX technology. The goals and objectives consist of the following. 1. IMMEX cases with content emphasis on chemical structure and function are being collated and adapted for summative problem solving assessment, and additional cases are being devised as needed to complement current cases with structure and function content bases. 2. Analysis of dynamic problem solving behavior for individual cases within IMMEX is being adapted to allow the measurement of the structure and function cognitive domain across several cases, and cognitive measures. 3. The internal reliability and validity of the comparison of structure and function problem solving is being established across multiple IMMEX cases using a combination of measures including Item Response Theory analysis as well as performance and progress measures derived by neural network and hidden Markov modeling. These include measurement rubrics for transitionsbetween dynamic problem solving states for students to determine gains in the useof successful problem solving strategies for students in the first two years of college chemistry. 4. A remote IMMEX server is being established at the offices of the ACS Examinations Institute to enhance the ability to provide IMMEX cases to a growing national pool of students. 5. A reporting system is being devised that will be published from the Exams Institute to provide instructors with reports of the gains in successful problem solving strategies for their students participating in this project.Intellectual meritThis project is grounded in the prior research on assessment of problem solving usingIMMEX technologies. A range of problems, based on the relationship between structureand function, is being developed and the resulting assessment data are being used to develop predictive models for individual student problem solvers. The resultant database of student problem solving behavior also provides a resource for chemical educators.Broader ImpactThis project involves the extension of new assessment technologies to a nationalpopulation. The resulting reliable, normed assessments from a trusted source (the ACSExaminations Institute) that focus on deeper aspects of problem solving will be availableto a broader audience. The availability of these instruments is expected to facilitate the spread of reformed curricula that emphasize deep learning and problem solving.