Collaborative Research: Developing Items to Assess Students' Understanding of Scientific Practices in Chemistry Laboratory Settings

合作研究：开发项目来评估学生对化学实验室环境中科学实践的理解

• 批准号: 1708506
• 负责人: Melanie Cooper
• 金额: $ 24.45万
• 依托单位: Michigan State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1708506&HistoricalAwards=false
• 关键词: Collaborative; Research; Developing; Items; Assess

Almost all introductory college chemistry courses have a laboratory component where students are supposed to learn about scientific practices such as designing experiments, analyzing data, and using experimental evidence to explain their findings. However, few valid and reliable tests exist that can reliably measure students' ability to do these scientific practices. Instead, chemistry laboratory tests typically focus on measuring students' knowledge of chemistry concepts and their skill at manipulating laboratory equipment. This Improving Undergraduate STEM Education (IUSE:EHR) Exploration & Design project will fill this important gap in general chemistry laboratories by developing and validating questions that can measure how well students can do specific scientific practices. The questions will include both open-ended and multiple-choice formats, to make them useful for small and large enrollment courses. The questions will initially be tested at a research university (Michigan State University, MSU), a Hispanic-serving institution (Florida International University, FIU), and a primarily undergraduate institution (Grand Valley State University, GVSU). As a result, the project team may be able to identify specific laboratory activities that help students become more proficient at using particular scientific practices. The scientific practice questions and effective laboratory activities identified will be shared with college chemistry instructors and could be adapted for use by high school chemistry teachers.To accomplish these goals, the project team will develop sets of questions (i.e. assessment items) for the three scientific practices of (1) planning and carrying out investigations; (2) analyzing and interpreting data; and (3) constructing explanations and engaging in argument from evidence in four different chemistry topic areas (spectroscopic measurements, gas law relationships, stoichiometry, and kinetics). Development of the assessment items will use an iterative process that includes identifying the key elements of each practice to assess; developing questions and scoring rubrics; and establishing validity, reliability, and practicality of the assessment items. Assessment items will be reviewed by an advisory board of members with extensive expertise in both laboratory instruction and instrument development, tested using students ?think aloud? interviews, and revised as necessary. Next, the project team will administer these assessment items in general chemistry labs at MSU, FIU, and GVSU. They will score student performance and examine the relationship between the levels of student engagement with scientific practices in the various laboratory courses and students' abilities to perform the practices effectively in the corresponding assessment items. Establishing a process for assessing students? proficiency in scientific practices will provide a model that others may use to develop assessments for additional scientific practices or for other scientific disciplines.

几乎所有的大学化学入门课程都有实验室部分，学生应该学习科学实践，如设计实验，分析数据，并使用实验证据来解释他们的发现。然而，很少有有效和可靠的测试存在，可以可靠地衡量学生的能力，做这些科学的做法。相反，化学实验室测试通常侧重于测量学生的化学概念的知识和他们在操作实验室设备的技能。这个改进本科STEM教育（IUSE：EHR）探索设计项目将通过开发和验证问题来填补普通化学实验室的这一重要空白，这些问题可以衡量学生在具体科学实践中的表现。这些问题将包括开放式和多项选择的格式，使他们对小型和大型招生课程有用。这些问题最初将在一所研究型大学（密歇根州立大学，MSU），一所西班牙裔服务机构（佛罗里达国际大学，FIU）和一所主要的本科院校（大峡谷州立大学，GVSU）进行测试。 因此，项目团队可能能够确定特定的实验室活动，帮助学生更熟练地使用特定的科学实践。确定的科学实践问题和有效的实验室活动将与大学化学教师分享，并可供高中化学教师使用。（即评估项目）的三个科学实践：（1）规划和开展调查;（2）分析和解释数据;以及（3）在四个不同的化学主题领域（光谱测量、气体定律关系、化学计量学和动力学）中构建解释并参与证据论证。评估项目的开发将使用一个迭代过程，包括确定每个实践的关键要素进行评估;开发问题和评分规则;以及建立评估项目的有效性，可靠性和实用性。评估项目将由一个顾问委员会审查，该委员会的成员在实验室教学和仪器开发方面具有广泛的专业知识，并使用学生进行测试。大声思考？采访，并根据需要进行修改。接下来，项目团队将在MSU，FIU和GVSU的普通化学实验室管理这些评估项目。 他们将对学生的表现进行评分，并研究学生在各种实验室课程中参与科学实践的程度与学生在相应评估项目中有效进行实践的能力之间的关系。建立评估学生的程序？对科学实践的熟练程度将提供一个模式，其他人可利用该模式为其他科学实践或其他科学学科制定评估。

项目成果

Development and Validation of Scientific Practices Assessment Tasks for the General Chemistry Laboratory

普通化学实验室科学实践评估任务的开发和验证

• DOI: 10.1021/acs.jchemed.9b00897
• 发表时间: 2020
• 期刊: Journal of Chemical Education
• 影响因子: 3
• 作者: Stephenson, Norda S.;Duffy, Erin M.;Day, Elizabeth L.;Padilla, Kira;Herrington, Deborah G.;Cooper, Melanie M.;Carmel, Justin H.
• 通讯作者: Carmel, Justin H.