Collaborative Research: Developing Items to Assess Students' Understanding of Scientific Practices in Chemistry Laboratory Settings

合作研究：开发项目来评估学生对化学实验室环境中科学实践的理解

• 批准号: 1708666
• 负责人: Deborah Herrington
• 金额: $ 5.45万
• 依托单位: Grand Valley State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1708666&HistoricalAwards=false
• 关键词: Collaborative; Research; Developing; Items; Assess

Almost all introductory college chemistry courses have a laboratory component where students are supposed to learn about scientific practices such as designing experiments, analyzing data, and using experimental evidence to explain their findings. However, few valid and reliable tests exist that can reliably measure students' ability to do these scientific practices. Instead, chemistry laboratory tests typically focus on measuring students' knowledge of chemistry concepts and their skill at manipulating laboratory equipment. This Improving Undergraduate STEM Education (IUSE:EHR) Exploration & Design project will fill this important gap in general chemistry laboratories by developing and validating questions that can measure how well students can do specific scientific practices. The questions will include both open-ended and multiple-choice formats, to make them useful for small and large enrollment courses. The questions will initially be tested at a research university (Michigan State University, MSU), a Hispanic-serving institution (Florida International University, FIU), and a primarily undergraduate institution (Grand Valley State University, GVSU). As a result, the project team may be able to identify specific laboratory activities that help students become more proficient at using particular scientific practices. The scientific practice questions and effective laboratory activities identified will be shared with college chemistry instructors and could be adapted for use by high school chemistry teachers.To accomplish these goals, the project team will develop sets of questions (i.e. assessment items) for the three scientific practices of (1) planning and carrying out investigations; (2) analyzing and interpreting data; and (3) constructing explanations and engaging in argument from evidence in four different chemistry topic areas (spectroscopic measurements, gas law relationships, stoichiometry, and kinetics). Development of the assessment items will use an iterative process that includes identifying the key elements of each practice to assess; developing questions and scoring rubrics; and establishing validity, reliability, and practicality of the assessment items. Assessment items will be reviewed by an advisory board of members with extensive expertise in both laboratory instruction and instrument development, tested using students ?think aloud? interviews, and revised as necessary. Next, the project team will administer these assessment items in general chemistry labs at MSU, FIU, and GVSU. They will score student performance and examine the relationship between the levels of student engagement with scientific practices in the various laboratory courses and students' abilities to perform the practices effectively in the corresponding assessment items. Establishing a process for assessing students? proficiency in scientific practices will provide a model that others may use to develop assessments for additional scientific practices or for other scientific disciplines.

几乎所有的入门化学化学课程都有一个实验室组成部分，学生应该在其中了解科学实践，例如设计实验，分析数据以及使用实验证据来解释他们的发现。但是，很少有有效和可靠的测试可以可靠地衡量学生进行这些科学实践的能力。相反，化学实验室测试通常集中于衡量学生对化学概念的知识及其操纵实验室设备的技巧。这项改善的本科STEM教育（IUSE：EHR）探索和设计项目将通过开发和验证可以衡量学生能够进行特定科学实践的能力的问题来填补这一重要差距。这些问题将包括开放式和多项选择格式，以使其对小型和大型入学课程有用。这些问题最初将在一所研究大学（密歇根州立大学密歇根州立大学），西班牙裔服务机构（佛罗里达国际大学，FIU）和主要是本科机构（GRAND VALLEY州立大学，GVSU）中进行测试。 结果，项目团队可能能够确定特定的实验室活动，以帮助学生更熟练使用特定的科学实践。科学实践问题和确定的有效实验室活动将与大学化学教师共享，并可以通过高中化学老师进行调整。要实现这些目标，项目团队将开发（即评估项目）（即评估项目），以（1）规划和进行研究的三种科学实践； （2）分析和解释数据； （3）在四个不同的化学主题领域（光谱测量，气体法关系，化学计量和动力学）中构建解释并参与论证。评估项目的开发将使用迭代过程，其中包括确定每种练习的关键要素；制定问题和评分评分；并确定评估项目的有效性，可靠性和实用性。评估项目将由具有广泛专业知识的成员顾问委员会在实验室教学和仪器开发方面进行审查，并使用学生进行了测试？大声思考？访谈，并根据需要进行修订。接下来，项目团队将在MSU，FIU和GVSU中管理这些评估项目。 他们将评分学生的表现，并研究学生参与的水平与各种实验室课程中的科学实践的水平与学生在相应评估项目中有效执行这些实践的能力之间的关系。建立评估学生的过程？熟练的科学实践将提供一个模型，其他人可能会用来为其他科学实践或其他科学学科开发评估。

项目成果

Development and Validation of Scientific Practices Assessment Tasks for the General Chemistry Laboratory

普通化学实验室科学实践评估任务的开发和验证

• DOI: 10.1021/acs.jchemed.9b00897
• 发表时间: 2020
• 期刊: Journal of Chemical Education
• 影响因子: 3
• 作者: Stephenson, Norda S.;Duffy, Erin M.;Day, Elizabeth L.;Padilla, Kira;Herrington, Deborah G.;Cooper, Melanie M.;Carmel, Justin H.
• 通讯作者: Carmel, Justin H.