Collaborative Research: Expanding a National Network for Automated Analysis of Constructed Response Assessments to Reveal Student Thinking in STEM

合作研究:扩大构建反应评估自动分析的国家网络,以揭示学生在 STEM 中的思维

基本信息

  • 批准号:
    1322851
  • 负责人:
  • 金额:
    $ 18.8万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2013
  • 资助国家:
    美国
  • 起止时间:
    2013-09-15 至 2019-02-28
  • 项目状态:
    已结题

项目摘要

This project is being conducted by a large team across 6 institutions that is building on already developed open-ended constructed response versions of well-established concept inventories that can be accurately assessed with already created computer automated analysis resources. The computer-automated analyses are able to predict human ratings of students' work on these topics and have demonstrated higher inter-rater reliability than a group of trained expert human graders. Constructed response assessments reveal more about student thinking and the persistence of misconceptions than do multiple-choice questions, but require more analysis on the part of the educator. In past work, items designed to identify important disciplinary constructs were created based on prior research. The items were then administered via online course management systems where students entered responses. Lexical and statistical analysis software was used to predict expert ratings of student responses. To date, the work has focused primarily in the fields of biology and chemistry in biological contexts. The current project is leveraging the previous research on Automated Assessment of Constructed Response (AACR), and extending the work to other institutions and other STEM disciplines. The specific goals of this project are to: 1. Create a community web portal for the Automated Assessment of Constructed Response (AACR) assessments to expand and deepen collaborations among STEM education researchers, thus providing the infrastructure for expanding the community of researchers and supporting the adoption and implementation of the innovative instructional materials by instructors at other institutions. 2. Propagate the innovations by providing instructors with professional development and long-term, ongoing support to use the assessments. This includes information about common student conceptions revealed by the questions, instructional materials for addressing conceptual barriers, and the opportunity to join a community of practitioners who are using the AACR questions and exchanging materials. 3. Expand the basic research to create and validate AACR questions in introductory chemistry, chemical engineering, and statistics. 4. Engage in ongoing project evaluation for continuous quality improvement and to document the challenges and successes the project encounters. 5. Lay the foundation for sustainability by providing interfaces for e-text publishers, Learning Management System vendors, and Massively Open Online Courses as potential revenue streams to operate and maintain the online infrastructure.Intellectual Merit:Improving STEM education requires valid and reliable instruments that provide insight into student thinking. The automated analysis of constructed response assessments have the potential to assess "big ideas" in STEM in a richer, more multi-faceted manner than multiple-choice instruments. This project is extending the number of these items and provide an online community where instructors may obtain, score, and contribute to the library of items and resources necessary for their analyses. Broader Impacts:The web portal is extending the use of the products created in this project to instructors nationwide. In addition it is providing the foundation for a national collaboration of science and engineering educators interested in developing deeper conceptual assessment tools and supports and mentors postdoctoral research fellows, and graduate research assistants in STEM education research.
该项目由6个机构的一个大型团队进行,该团队正在建立已经开发的开放式结构响应版本的成熟概念清单,可以用已经创建的计算机自动分析资源进行准确评估。 计算机自动化分析能够预测对学生在这些主题上的工作的人类评分,并且比一组训练有素的专家人类评分员表现出更高的评分员间可靠性。建构反应评估比多项选择题更能揭示学生的思维和误解的持续性,但需要教育者进行更多的分析。在过去的工作中,旨在确定重要学科结构的项目是根据先前的研究创建的。然后,这些项目通过在线课程管理系统进行管理,学生们可以输入答案。词汇和统计分析软件被用来预测学生的反应专家评级。到目前为止,工作主要集中在生物学和生物学背景下的化学领域。目前的项目是利用以前的研究自动评估的构造响应(AACR),并将工作扩展到其他机构和其他STEM学科。本项目的具体目标是:1.为建构反应自动评估(AACR)评估创建一个社区门户网站,以扩大和深化STEM教育研究人员之间的合作,从而为扩大研究人员社区提供基础设施,并支持其他机构的教师采用和实施创新的教学材料。2.通过为教师提供专业发展和长期持续的支持来使用评估,以推广创新。这包括有关问题所揭示的常见学生概念的信息,解决概念障碍的教学材料,以及加入使用AACR问题和交换材料的从业者社区的机会。3.扩展基础研究,以创建和验证AACR问题,介绍化学,化学工程和统计学。4.参与持续的项目评估,以实现持续的质量改进,并记录项目遇到的挑战和成功。5.通过为电子文本出版商、学习管理系统供应商和大规模开放在线课程提供接口,为可持续发展奠定基础,作为运营和维护在线基础设施的潜在收入来源。智力优势:改善STEM教育需要有效和可靠的工具,以洞察学生的思维。对结构化反应评估的自动分析有可能以比多项选择工具更丰富、更多方面的方式评估STEM中的“大想法”。该项目正在扩大这些项目的数量,并提供一个在线社区,教师可以获得,评分,并为他们的分析所需的项目和资源库作出贡献。更广泛的影响:该门户网站正在将该项目中创建的产品的使用范围扩大到全国各地的教员。此外,它还为有兴趣开发更深入的概念评估工具的科学和工程教育工作者的全国合作提供基础,并支持和指导博士后研究员和STEM教育研究的研究生研究助理。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Michelle Smith其他文献

The complete genome sequence of Eimeria tenella (Tyzzer 1929), a common gut parasite of chickens [version 1; peer review: 2 approved]
柔嫩艾美耳球虫 (Tyzzer 1929) 的完整基因组序列,这是一种常见的鸡肠道寄生虫 [版本 1;
  • DOI:
  • 发表时间:
    2021
  • 期刊:
  • 影响因子:
    0
  • 作者:
    E. Aunin;U. Böhme;D. Blake;A. Dove;Michelle Smith;Craig Corton;K. Oliver;Emma Betteridge;M. Quail;Shane A. McCarthy;J. Wood;A. Tracey;J. Torrance;Ying Sims;K. Howe;Richard J. Challis;M. Berriman;A. Reid
  • 通讯作者:
    A. Reid
Benchmarking ultra-high molecular weight DNA preservation methods for long-read and long-range sequencing
用于长读长和长程测序的超高分子量 DNA 保存方法的基准测试
  • DOI:
    10.1101/2021.07.13.451380
  • 发表时间:
    2021
  • 期刊:
  • 影响因子:
    9.2
  • 作者:
    Hollis A. Dahn;J. Mountcastle;Jennifer R. Balacco;S. Winkler;Iliana Bista;A. Schmitt;O. V. Pettersson;G. Formenti;K. Oliver;Michelle Smith;Wenhua Tan;A. Kraus;Stephen Mac;L. Komoroske;Tanya M. Lama;A. Crawford;R. Murphy;Samara Brown;A. F. Scott;P. Morin;E. Jarvis;O. Fedrigo
  • 通讯作者:
    O. Fedrigo
Social and Romantic Relationships and Sexual Health: A qualitative exploration of individuals with traumatic brain injury (TBI)
  • DOI:
    10.1016/j.apmr.2024.02.312
  • 发表时间:
    2024-04-01
  • 期刊:
  • 影响因子:
  • 作者:
    Reilly Edmonds;Olga Garduño-Ortega;Michelle Smith;Judy Wilson;Tamara Bushnik
  • 通讯作者:
    Tamara Bushnik
An Analysis of Barriers and Supporters for Enrollment in Traumatic Brain Injury Model Systems Research
  • DOI:
    10.1016/j.apmr.2018.08.084
  • 发表时间:
    2018-11-01
  • 期刊:
  • 影响因子:
  • 作者:
    Alejandro Zarate;Coralynn Long;Ellen Hada;Michael Juszczak;Michelle Smith;Tamara Bushnik
  • 通讯作者:
    Tamara Bushnik
Suicide Risk Screening and Assessment Practices in A Multi-Center Outcome Study Following Inpatient TBI Rehabilitation
  • DOI:
    10.1016/j.apmr.2022.12.152
  • 发表时间:
    2023-03-01
  • 期刊:
  • 影响因子:
  • 作者:
    Stephanie Agtarap;Megan Douglas;Jacob Finn;Michelle Smith;Marc Silva
  • 通讯作者:
    Marc Silva

Michelle Smith的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Michelle Smith', 18)}}的其他基金

Collaborative Research: Science with the People: Collaborative analysis of government data for policy reach and structural change in environmentally contested regions
合作研究:科学与人民:对政府数据进行合作分析,以了解环境争议地区的政策影响力和结构变化
  • 批准号:
    2318239
  • 财政年份:
    2023
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative research: From Community to Practice: Evaluating How Open Educational Resources Facilitate Implementation of Vision and Change Principles Across Diverse Institutions
合作研究:从社区到实践:评估开放教育资源如何促进不同机构愿景和变革原则的实施
  • 批准号:
    2126110
  • 财政年份:
    2021
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Building Adaptability for Teaching Online through Peer-Reviewed, Active-Learning Resources and Professional Development
通过同行评审、主动学习资源和专业发展培养在线教学的适应性
  • 批准号:
    2044189
  • 财政年份:
    2021
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: Exploring How Undergraduate Learning of Multifactorial Genetics Affects Belief in Genetic Determinism
合作研究:探索本科生多因素遗传学学习如何影响对遗传决定论的信仰
  • 批准号:
    1914965
  • 财政年份:
    2020
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Development of the Biology Lab Inventory of Critical Thinking for Ecology (Eco-BLIC)
生态学批判性思维生物学实验室清单 (Eco-BLIC) 的开发
  • 批准号:
    1909602
  • 财政年份:
    2019
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: Expanding a National Network for Automated Analysis of Constructed Response Assessments to Reveal Student Thinking in STEM
合作研究:扩大构建反应评估自动分析的国家网络,以揭示学生在 STEM 中的思维
  • 批准号:
    1912077
  • 财政年份:
    2018
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: Navigating from Vision to Change with Bio-MAPS
合作研究:利用 Bio-MAPS 从愿景转向变革
  • 批准号:
    1911788
  • 财政年份:
    2018
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: A Community of Enhanced Assessment Facilitates Reformed Teaching
协作研究:增强评估社区促进教学改革
  • 批准号:
    1347578
  • 财政年份:
    2013
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Catalyzing Institutional Change Through Synergistic Observation and Professional Development Programs
通过协同观察和专业发展计划促进制度变革
  • 批准号:
    1347577
  • 财政年份:
    2013
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: Navigating from Vision to Change with Bio-MAPS
合作研究:利用 Bio-MAPS 从愿景转向变革
  • 批准号:
    1322556
  • 财政年份:
    2013
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant

相似国自然基金

Research on Quantum Field Theory without a Lagrangian Description
  • 批准号:
    24ZR1403900
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
Cell Research
  • 批准号:
    31224802
  • 批准年份:
    2012
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research
  • 批准号:
    31024804
  • 批准年份:
    2010
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research (细胞研究)
  • 批准号:
    30824808
  • 批准年份:
    2008
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
  • 批准号:
    10774081
  • 批准年份:
    2007
  • 资助金额:
    45.0 万元
  • 项目类别:
    面上项目

相似海外基金

Collaborative Research: Evaluating Access: How a Multi-Institutional Network Promotes Equity and Cultural Change through Expanding Student Voice
合作研究:评估访问:多机构网络如何通过扩大学生的声音来促进公平和文化变革
  • 批准号:
    2309310
  • 财政年份:
    2024
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: Evaluating Access: How a Multi-Institutional Network Promotes Equity and Cultural Change through Expanding Student Voice
合作研究:评估访问:多机构网络如何通过扩大学生的声音来促进公平和文化变革
  • 批准号:
    2309308
  • 财政年份:
    2024
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: Evaluating Access: How a Multi-Institutional Network Promotes Equity and Cultural Change through Expanding Student Voice
合作研究:评估访问:多机构网络如何通过扩大学生的声音来促进公平和文化变革
  • 批准号:
    2309309
  • 财政年份:
    2024
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: Evaluating Access: How a Multi-Institutional Network Promotes Equity and Cultural Change through Expanding Student Voice
合作研究:评估访问:多机构网络如何通过扩大学生的声音来促进公平和文化变革
  • 批准号:
    2309311
  • 财政年份:
    2024
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: Evaluating Access: How a Multi-Institutional Network Promotes Equity and Cultural Change through Expanding Student Voice
合作研究:评估访问:多机构网络如何通过扩大学生的声音来促进公平和文化变革
  • 批准号:
    2309307
  • 财政年份:
    2024
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: EPIIC: Expanding Team Capacity for High Impact and New Growth (ETCHING) Cohort
合作研究: EPIIC:扩大高影响力和新增长 (ETCHING) 队列的团队能力
  • 批准号:
    2331217
  • 财政年份:
    2023
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: DESC: Type II: REFRESH: Revisiting Expanding FPGA Real-estate for Environmentally Sustainability Heterogeneous-Systems
合作研究:DESC:类型 II:REFRESH:重新审视扩展 FPGA 空间以实现环境可持续性异构系统
  • 批准号:
    2324865
  • 财政年份:
    2023
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: EPIIC: Expanding Team Capacity for High Impact and New Growth (ETCHING) Cohort
合作研究: EPIIC:扩大高影响力和新增长 (ETCHING) 队列的团队能力
  • 批准号:
    2331216
  • 财政年份:
    2023
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Standard Grant
Collaborative Research: Expanding the diversity of iron oxidation mechanisms via genetics, microscopy and 'omics in Leptothrix
合作研究:通过遗传学、显微镜学和组学扩大细丝菌铁氧化机制的多样性
  • 批准号:
    2243578
  • 财政年份:
    2023
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
Collaborative Research: Expanding the diversity of iron oxidation mechanisms via genetics, microscopy and 'omics in Leptothrix
合作研究:通过遗传学、显微镜学和组学扩大细丝菌铁氧化机制的多样性
  • 批准号:
    2243577
  • 财政年份:
    2023
  • 资助金额:
    $ 18.8万
  • 项目类别:
    Continuing Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了