Crowd-Sourced Online Nexus for Developing Assessments of Middle-school Physical Science Disciplinary Core Ideas
用于开发中学物理科学学科核心思想评估的众包在线关系
基本信息
- 批准号:2101493
- 负责人:
- 金额:$ 160.06万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Continuing Grant
- 财政年份:2021
- 资助国家:美国
- 起止时间:2021-09-01 至 2024-08-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
This project will develop and test a web-based platform to increase the quality of teacher-administered tests in science classrooms. It draws on classroom teacher knowledge while employing the rigorous statistical methods used in standardized assessment creation and validation. The content focus is on the disciplinary core ideas for grades 6-8 physical science in the Next Generation Science Standards (NGSS). Teachers now spend an estimate 20% of their time in assessment, yet have relatively few tools to draw upon when creating them. Over time, they learn to adapt items from available curriculum materials and textbooks. On the other hand, standardized assessment developers have the benefit of expert item writers, long development cycles, a large and diverse student population, and sophisticated psychometric tools. This project combines these two approaches, drawing upon teachers to contribute their best items, then immediately piloting them using crowdsourced subjects. Psychometric analysis generates measures of item quality and then “recycles” items to participating teachers for improvement. In this way, a large test item bank will be constructed utilizing teacher input with each item possessing: appropriate reading levels, NGSS alignment, scientific accuracy, appropriate difficulty, high statistical discrimination, and negligible difference by gender, race, or ethnicity. Involvement in this project has potential benefits for teachers lacking formal training in assessment, familiarizing participants with the NGSS, and with the elements of high-quality test development.The project will gauge the merits of a novel collaborative system for the development and validation of high-quality test items and assessment instruments. It will measure the degree to which teachers can generate effective items and improve existing items exhibiting problematic issues when given the guidance of rigorous psychometric measures that estimate item quality. It will build on earlier research showing that an adult, crowd-sourced sample works well as an initial proxy for grade 6-8 science students, allowing for extremely rapid feedback on item quality (often overnight), with item response theory computation used to establish item difficulty, item discrimination, guessing levels, and differential item functioning (gender and racial/ethnicity bias). In addition, computed measures of misconception strength, scientific correctness, reading level, and match to the NGSS will help to guide revision by teachers. Use of Bayesian futility analysis will “triage” items, minimizing costly testing of items when deemed unlikely to meet item quality criteria, lowering costs. Field testing with a large sample of grade 6-8 students will provide a final check on item quality. Items will be developed much more inexpensively than by methods used for standardized test development. Two pairs (public-release and secure for chemistry and physics) of assessment instruments will be constructed and be freely available to science teachers for classroom use and by education researchers and curriculum developers. A system that provides quick feedback on item quality could potentially transform university instruction and professional development opportunities in assessment. While starting with selected response (multiple-choice) items, the project will be able to implement a larger variety of formats in the future, incorporating automated approaches as they become available.The Discovery Research preK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该项目将开发和测试一个基于网络的平台,以提高教师在科学课堂上进行的考试的质量。它利用课堂教师的知识,同时使用标准化评估、创建和验证中使用的严格统计方法。内容重点是下一代科学标准(NGSS)中6-8年级物理科学的学科核心理念。教师现在估计有20%的时间花在评估上,但在制作这些课程时,可供参考的工具相对较少。随着时间的推移,他们学会了从现有的课程材料和教科书中改编内容。另一方面,标准化评估开发人员拥有专业的项目编写者、较长的开发周期、大量且多样化的学生群体以及复杂的心理测量工具。这个项目结合了这两种方法,让老师贡献他们最好的项目,然后立即使用众包科目进行试点。心理测量学分析产生项目质量的测量,然后将项目回收给参与的教师进行改进。通过这种方式,将利用教师的输入来构建一个大型试题库,每个试题具有:适当的阅读水平、NGSS对齐、科学准确性、适当的难度、高度的统计学差别以及可以忽略不同性别、种族或民族的差异。参与这个项目对缺乏正规评估培训的教师有潜在的好处,让参与者熟悉NGSS,并了解高质量测试开发的要素。该项目将衡量一个新的协作系统的优点,以开发和验证高质量的测试项目和评估工具。它将衡量教师在接受评估项目质量的严格心理测量措施的指导下,能够在多大程度上产生有效的项目并改进现有的问题项目。它将建立在早期研究的基础上,该研究表明,成人、众包样本可以很好地作为6-8年级理科学生的初始替代,允许对项目质量进行极快的反馈(通常是一夜之间),项目反应理论计算用于确定项目难度、项目辨别、猜测水平和不同的项目功能(性别和种族/民族偏见)。此外,计算错误概念强度、科学正确性、阅读水平以及与NGSS的匹配度将有助于指导教师进行修改。使用贝叶斯无效性分析将对物品进行分类,最大限度地减少在被认为不太可能满足物品质量标准时对物品进行昂贵的测试,从而降低成本。对6-8年级学生进行大样本的实地测试将对项目质量进行最终检查。试题的开发将比标准化测试开发的方法便宜得多。将建造两对评估工具(公开发布和化学和物理的安全),供科学教师课堂使用以及教育研究人员和课程制定者免费使用。一个对项目质量提供快速反馈的系统可能会潜在地改变大学教学和评估中的专业发展机会。该项目从选定的答案(多项选择)开始,未来将能够实施更多种类的格式,并在可用时纳入自动化方法。探索研究预科-12课程(DRK-12)旨在通过研究和开发创新资源、模型和工具,显著提高预科-12年级学生和教师在科学、技术、工程和数学(STEM)方面的学习和教学。DRK-12计划中的项目建立在STEM教育的基础研究和先前的研究和开发工作的基础上,为拟议的项目提供了理论和经验上的证明。该奖项反映了NSF的法定使命,并通过使用基金会的智力优势和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Philip Sadler其他文献
Evaluating a possible new paradigm for recruitment dynamics: predicting poor recruitment for striped bass (emMorone saxatilis/em) from an environmental variable
评估招聘动态的一种可能的新范式:根据一个环境变量预测条纹鲈鱼(莫罗尼萨克斯鱼)的招聘不佳
- DOI:
10.1016/j.fishres.2022.106329 - 发表时间:
2022-08-01 - 期刊:
- 影响因子:2.300
- 作者:
Julie M. Gross;Philip Sadler;John M. Hoenig - 通讯作者:
John M. Hoenig
Kitchen Chemistry Boosts STEM Identity and Increases STEM Career Interests
厨房化学提升 STEM 认同感并增加 STEM 职业兴趣
- DOI:
- 发表时间:
2024 - 期刊:
- 影响因子:3
- 作者:
Chen Chen;Jiaxin Chen;Liang Ju;G. Sonnert;Susan Sunbury;Philip Sadler - 通讯作者:
Philip Sadler
Philip Sadler的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Philip Sadler', 18)}}的其他基金
Instrument Development: Racially & Ethnically Minoritized Youths’ Varied Out-Of-School-Time Experiences and Their Effects on STEM Attitudes, Identity, and Career Interest
仪器开发:种族
- 批准号:
2215050 - 财政年份:2022
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
Study of Preservice Teachers' Science Content Knowledge and Pedagogical Content Knowledge
职前教师科学内容知识与教学内容知识研究
- 批准号:
2013263 - 财政年份:2020
- 资助金额:
$ 160.06万 - 项目类别:
Continuing Grant
Collaborative Research: A study of How Pre-College Informal Activities Influence Female Participation in STEM Careers
合作研究:大学前非正式活动如何影响女性参与 STEM 职业的研究
- 批准号:
1612375 - 财政年份:2016
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
MOSART HSPS: Misconceptions Oriented Standards-Based Assessment Resource for Teachers of High School Physical Sciences
MOSART HSPS:面向高中物理科学教师的基于标准的误解评估资源
- 批准号:
1621210 - 财政年份:2016
- 资助金额:
$ 160.06万 - 项目类别:
Continuing Grant
Thinking Spatially about the Universe- A Physical and Virtual Laboratory for Middle School Science
对宇宙的空间思考——中学科学的物理和虚拟实验室
- 批准号:
1502798 - 财政年份:2015
- 资助金额:
$ 160.06万 - 项目类别:
Continuing Grant
Professional Development Models and Outcomes for Science Teachers (PDMOST)
科学教师的专业发展模式和成果(PDMOST)
- 批准号:
1417438 - 财政年份:2014
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
Collaborative Research: Innovative Technology-Enabled Astronomy for Middle Schools II (ITEAMS II)
合作研究:创新技术支持的中学天文学 II (ITEAMS II)
- 批准号:
1433431 - 财政年份:2014
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
CER: Factors Influencing College Success in Information Technology (FICSIT)
CER:影响大学信息技术成功的因素 (FICSIT)
- 批准号:
1339200 - 财政年份:2014
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
EAGER: ITEST Longitudinal Study
EAGER:ITEST 纵向研究
- 批准号:
1355323 - 财政年份:2013
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
Outcome Predictions of Students in Massive Open Online Courses (OPSMOOC)
大规模开放在线课程(OPSMOOC)学生的结果预测
- 批准号:
1337166 - 财政年份:2013
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
相似海外基金
Towards innovative and affordable sodium- and zinc-based energy storage systems based on more sustainable and locally-sourced materials (eNargiZinc)
开发基于更可持续和本地采购的材料的创新且经济实惠的钠基和锌基储能系统 (eNargiZinc)
- 批准号:
EP/Y03127X/1 - 财政年份:2024
- 资助金额:
$ 160.06万 - 项目类别:
Research Grant
SCC-PG WECAN Smart Toolkit: Wellbeing Enhancement through Crowd-sourced Assessment of Neighborhood-infrastructure
SCC-PG WECAN 智能工具包:通过社区基础设施众包评估增强福祉
- 批准号:
2332339 - 财政年份:2024
- 资助金额:
$ 160.06万 - 项目类别:
Standard Grant
Towards innovative and affordable sodium- and zinc-based energy storage systems based on more sustainable and locally-sourced materials
开发基于更可持续和本地采购的材料的创新且经济实惠的钠基和锌基储能系统
- 批准号:
EP/Y031253/1 - 财政年份:2024
- 资助金额:
$ 160.06万 - 项目类别:
Research Grant
Sustainably sourced biopolymers for use in complex paper packaging
用于复杂纸包装的可持续来源的生物聚合物
- 批准号:
10078245 - 财政年份:2023
- 资助金额:
$ 160.06万 - 项目类别:
Collaborative R&D
INBUILT: InNovative Bio=o-soUrced, re-used & recycled products coupled with BIM-based dIgitaL platform for very low carbon consTruction, circular economy, energy and resource efficiency
内置:创新生物 = 来源、重复使用
- 批准号:
10101595 - 财政年份:2023
- 资助金额:
$ 160.06万 - 项目类别:
EU-Funded
High performance 3D-Li anodes with recycled and sustainably sourced carbon scaffolds
具有可回收和可持续来源的碳支架的高性能 3D-Li 阳极
- 批准号:
10079665 - 财政年份:2023
- 资助金额:
$ 160.06万 - 项目类别:
Collaborative R&D
Interactions of bio-sourced surfactants and fragrances
生物源表面活性剂和香料的相互作用
- 批准号:
2891702 - 财政年份:2023
- 资助金额:
$ 160.06万 - 项目类别:
Studentship
Explaining legal contracts to SMEs through conversational AI trained on open sourced contracts
通过受开源合同训练的对话式人工智能向中小企业解释法律合同
- 批准号:
10060279 - 财政年份:2023
- 资助金额:
$ 160.06万 - 项目类别:
Collaborative R&D
IMR: MT: xGTracker -- Mobile xG Performance Monitoring and Data Collection Platform to Enable Large-Scale Crowd-Sourced Measurement
IMR:MT:xGTracker——移动 xG 性能监控和数据收集平台,支持大规模众包测量
- 批准号:
2323174 - 财政年份:2023
- 资助金额:
$ 160.06万 - 项目类别:
Continuing Grant
Naturally sourced, sustainable and self healing flexible barrier packaging
天然来源、可持续且可自我修复的柔性阻隔包装
- 批准号:
10021522 - 财政年份:2022
- 资助金额:
$ 160.06万 - 项目类别:
Collaborative R&D