Findings from Empirical Within Study Comparisons about the Role of Pretests and Proxy Pretests in Adjusting for Selection Bias in STEM Quasi-Experiments
关于预测试和代理预测试在调整 STEM 准实验中选择偏差中的作用的实证研究比较结果
基本信息
- 批准号:1228866
- 负责人:
- 金额:$ 79.02万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2012
- 资助国家:美国
- 起止时间:2012-10-01 至 2016-09-30
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Experimental designs in education that include treatment and control groups that are randomly assigned to different conditions of an intervention are considered the most rigorous choice to be able to evaluate causal claims. However, a randomized controlled trial (RCT) is frequently not feasible in developing evidence around the impact of many STEM practices, programs and policies. Researchers from Northwestern University examine how quasi-experimental designs that include treatment and comparison groups and outcome measures, but that do not include the random assignment to treatment and control conditions, might produce the same quality of findings as experimental designs. The researchers are also examining if pretreatment measures of study outcomes might be replaced with proxy pretests, measures in the same domain as an original pretest but in a different form, to replicate the findings from experimental studies using the original pretest. Many STEM research studies frequently have access in quasi-experimental studies for data from these proxy pretests in archival datasets, such as the state longitudinal data systems.Researchers in this project have identified a number of RCTs that they use to examine whether changing the nature of the comparison group, from the original randomly assigned group, to one that is statistically adjusted from a larger population will show similar causal estimates as the original RCT. Using a within-study comparison, the researchers determine the differences in the RCT and quasi-experimental findings. They are studying the use of proxy pretreatment tests, such as math achievement data from state longitudinal data systems, to examine the extent to which these measures replicate findings in the original RCTs. They also examine the effect that modeling with a number of pre-intervention covariates has on causal estimates. If the differences between the causal estimates in the RCT and the new quasi-experimental study are low, then the quasi-experimental design is adequate to measure impact. Large data sets are increasingly available in education, especially with the development of district and local data systems that expand the information gathered about students, teachers and schools. These data sets provide opportunities for research and evaluation studies that can operate with population level data rather than samples of data drawn randomly from the population. The determination of the quality of quasi-experimental evaluation designs that result from this study provides information that can be used by policy makers and researchers to study questions about educational treatments, programs and policies that have been intractable to study. Removing the potential barrier of random assignment, while still maintaining the quality of an RCT, expands the methodological toolkit of evaluators.
教育中的实验设计,包括随机分配到不同干预条件的治疗组和对照组,被认为是能够评估因果关系的最严格选择。然而,随机对照试验(RCT)在围绕许多STEM实践,计划和政策的影响制定证据方面往往不可行。来自西北大学的研究人员研究了包括治疗组和对照组以及结果测量的准实验设计,但不包括随机分配给治疗和对照条件,可能会产生与实验设计相同的结果质量。研究人员还在研究是否可以用替代预测试来取代预测试的研究结果,替代预测试是与原始预测试相同但形式不同的测试,以复制使用原始预测试的实验研究结果。许多STEM研究经常在准实验研究中访问档案数据集中这些代理预测试的数据,例如州纵向数据系统。该项目的研究人员已经确定了一些RCT,他们使用这些RCT来检查是否改变对照组的性质,从最初的随机分配组,从一个更大的人群进行统计学调整后,将显示与原始RCT相似的因果估计。通过研究内比较,研究人员确定了RCT和准实验结果的差异。他们正在研究使用代理预处理测试,例如来自州纵向数据系统的数学成绩数据,以检查这些措施在多大程度上复制了原始RCT中的结果。他们还研究了使用一些干预前协变量建模对因果估计的影响。如果随机对照试验和新的准实验研究中的因果估计之间的差异很小,那么准实验设计足以衡量影响。 在教育方面,大型数据集越来越多,特别是随着地区和地方数据系统的发展,扩大了收集的关于学生、教师和学校的信息。这些数据集为研究和评价研究提供了机会,这些研究和评价研究可以使用人口一级的数据,而不是从人口中随机抽取的数据样本。从这项研究中产生的准实验性评估设计的质量的确定提供了可供决策者和研究人员使用的信息,以研究有关教育治疗,计划和政策的问题,一直难以研究。消除随机分配的潜在障碍,同时保持RCT的质量,扩大了评价者的方法工具包。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Thomas Cook其他文献
TCT-747 The CardiAMP Heart Failure Study: First Results from Unblinded Roll-In Phase
- DOI:
10.1016/j.jacc.2018.08.1971 - 发表时间:
2018-09-25 - 期刊:
- 影响因子:
- 作者:
Peter Johnston;Eric Duckers;Amish Raval;Thomas Cook;Jay Traverse;William Abraham;Peter Altman;Carl Pepine - 通讯作者:
Carl Pepine
An application of the transfer function to an economic-base model
- DOI:
10.1007/bf01284782 - 发表时间:
1979-07-01 - 期刊:
- 影响因子:2.100
- 作者:
Thomas Cook - 通讯作者:
Thomas Cook
["Aggregation issues in neighborhood research: A comparison of census geography and resident defined neighborhoods"]
[“邻里研究中的聚合问题:人口普查地理与居民定义的邻里的比较”]
- DOI:
- 发表时间:
2004 - 期刊:
- 影响因子:0
- 作者:
C. Coulton;Thomas Cook;M. Irwin - 通讯作者:
M. Irwin
Regional Comparison of Baseline Therapy in Patients Hospitalized for Acute Heart Failure with Systolic Dysfunction
- DOI:
10.1016/j.cardfail.2007.06.515 - 发表时间:
2007-08-01 - 期刊:
- 影响因子:
- 作者:
Norman C. Wang;Marvin A. Konstam;Mihai Gheorghiade;Robin Bechhofer;John C. Burnett;Liliana Grinfeld;Karl Swedberg;James E. Udelson;Thomas Cook;John Ouyang;Christopher Zimmer;Cesare Orlandi;Aldo P. Maggioni;Faiez Zannad; the EVEREST Investigators - 通讯作者:
the EVEREST Investigators
Covering Pre-existing, Acid-producing Fills with Alkaline Sandstone to Control Acid Mine Drainage
- DOI:
10.1007/s10230-008-0051-7 - 发表时间:
2008-10-15 - 期刊:
- 影响因子:2.100
- 作者:
Thomas Cook;Jeff Skousen;Tiff Hilton - 通讯作者:
Tiff Hilton
Thomas Cook的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Thomas Cook', 18)}}的其他基金
Creating a Theoretical and Empirical Foundation for Better Non-Equivalent Control Group Designs in STEM Research
为 STEM 研究中更好的非等效对照组设计奠定理论和经验基础
- 批准号:
1760458 - 财政年份:2018
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
The Internal Validity of External Validity: Using Experiments to Validate Three Approaches to Extrapolating Causal Inferences Beyond the Cutoff in Regression Discontinuity
外部有效性的内部有效性:使用实验验证三种方法来推断超出回归不连续性截止值的因果推论
- 批准号:
1544301 - 财政年份:2015
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
Doctoral Dissertation Research: Information, Understanding and Choice in the Chicago Public Schools
博士论文研究:芝加哥公立学校的信息、理解和选择
- 批准号:
0826512 - 财政年份:2008
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
A Multidisciplinary Graphics Design Laboratory
多学科图形设计实验室
- 批准号:
9152841 - 财政年份:1991
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
Evaluating the Societal Impact of Television: an Investigation Using Interrupted Time-Series Methodology
评估电视的社会影响:使用中断时间序列方法的调查
- 批准号:
7809368 - 财政年份:1978
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
Research Initiation - a Constitutive Relation For Living Human Skin
研究启动——活人皮肤的本构关系
- 批准号:
7704993 - 财政年份:1977
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
Evaluating the Societal Impact of Television: an Investigation Using Interrupted Time-Series Methodology
评估电视的社会影响:使用中断时间序列方法的调查
- 批准号:
7620889 - 财政年份:1976
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
Secondary Evaluation With Respect to the Plato and Ticcit Systems of Computer-Assisted Instructions
计算机辅助指令Plato和Ticcit系统的二次评估
- 批准号:
7602376 - 财政年份:1975
- 资助金额:
$ 79.02万 - 项目类别:
Contract
相似海外基金
Health risk and self-insurance within households: An empirical investigation using household panel survey
家庭内的健康风险和自我保险:使用家庭小组调查的实证调查
- 批准号:
23K01341 - 财政年份:2023
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Workshop: ProVis-EER: Developing Professional Vision into Empirical Practices within Engineering Education Research (EER) though Digital Apprenticeship
研讨会:ProVis-EER:通过数字学徒制将专业愿景发展为工程教育研究 (EER) 中的实证实践
- 批准号:
2112775 - 财政年份:2021
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
Effect of regional economic integration on within-country inequality in developing countries: empirical analysis using satellite imagery
区域经济一体化对发展中国家国内不平等的影响:利用卫星图像进行实证分析
- 批准号:
21K01460 - 财政年份:2021
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Empirical testing of how changing regulatory module membership affects module function within central metabolism
改变调节模块成员资格如何影响中央代谢内模块功能的实证检验
- 批准号:
1906486 - 财政年份:2019
- 资助金额:
$ 79.02万 - 项目类别:
Standard Grant
An Empirical Study of English Education in Taiwan: Analysis of lesson topics within senior high school English textbooks
台湾英语教育实证研究:高中英语教材课程主题分析
- 批准号:
19K00887 - 财政年份:2019
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Empirical studies on exposure to international competition and within-firm business restructuring
国际竞争与企业内部业务重组的实证研究
- 批准号:
15K03456 - 财政年份:2015
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
An empirical study of Japanese syllabic structure within a restricitve framework of Syllable Theory based on a dependency/licensing mechanism
基于依赖/许可机制的音节理论限制框架下的日语音节结构实证研究
- 批准号:
25370442 - 财政年份:2013
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Empirical Study of Barriers against "Bad News" Communication within the Organization
组织内“坏消息”沟通障碍的实证研究
- 批准号:
23830081 - 财政年份:2011
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Research Activity Start-up
An empirical study on the relationships between the principle's leadership and social capital within school
校内校长领导力与社会资本关系的实证研究
- 批准号:
22700802 - 财政年份:2010
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Young Scientists (B)
Empirical Analysis of resource allocation within household in Japan
日本家庭内部资源配置的实证分析
- 批准号:
22730247 - 财政年份:2010
- 资助金额:
$ 79.02万 - 项目类别:
Grant-in-Aid for Young Scientists (B)