Assessing the Impact of Systemic Initiative Programs: Modeling Best Practices of Data Collection, Analysis, and Dissemination of Results from Educational Research

本研究的目的是以六个改革驱动因素为指导，完成对全州、城市和农村系统倡议计划在改善教学实践和学生科学和数学成绩方面的具体效果的实证评估。本研究旨在评估SI计划产生和报告的数据类型、评估这些计划的程序(过程驱动因素)和经验(结果驱动因素)的方法程序、确定加强SI数据分析的创新技术和方法以及改进结果的传播和使用方法对SI计划的影响。确定了四个目标，以确保拟议研究的目的得以实现。这项研究的第一个目标将是调查和收集关于SI项目的所有可用数据。第二个目标是标准化解释SI方案报告的数据的机制。第三个目标是利用阿肯色州和阿肯色州内三个学区的数据，为开展SI项目的教育研究建立额外的战略模型。最终目标是制定一份关于计量和统计的从业人员指南，旨在加强SI方案和教育研究成果的传播。这项研究确定的结果包括：(A)可供感兴趣调查SI计划影响的其他研究人员使用的NSF SI数据库，(B)对过去和当前SI计划的具体影响的经验性评估，重点放在所有六个改革驱动因素上，以确定每个计划最成功的元素，(C)对当前分析数据的做法和程序的演示进行全面审查，这些数据和程序可以增强对结果的解释并可以容易地使用，以及(D)可用于提高开发或收集的数据的质量的模型，在未来的评估中可以完成的分析，以确定使用这些数据的特定计划或课堂效果，以及一份关于测量和统计的从业者指南，以改进从SI或教育计划获得的结果的传播。

The purpose of this study is to complete an empirical assessment of the specific effect of Statewide, Urban, and Rural Systemic Initiative Programs on improving the pedagogical practices and student achievement in science and mathematics Using the six reform drivers as a guide, a study has been designed to assess the types of data produced and reported by SI programs, methodological procedures to assess the procedural (process drivers) and empirical (outcome drivers) effects of these programs, to identify innovative techniques and approaches to enhance the analysis of SI data, and improve methods for dissemination and use of results on the impact of SI programs.Four objectives have been identified to ensure the purpose of the proposed study are met. The firstobjective of this study will be to investigate and collect all available data on SI programs. The second objective is to standardize a mechanism for interpreting data reported from the SI programs. The third objective is to model additional strategies for conducting educational research on SI programs using data from Arkansas and three school districts within Arkansas. The final objective is to develop a practitioner's guide on measurement and statistics and will be designed to enhance the dissemination of results from SI programs and educational research. The identified outcomes from this study include: (a) A NSF SI database that could be used by otherresearchers interested in investigating the impact of SI programs, (b) An empirical assessment of specific effects from past and current SI programs, focusing on all six reform drivers to identify the most successful elements of each program, (c) A comprehensive review of current practices toward analyzing data and demonstrations of procedures that may enhance the interpretation of results and can be easily employed, and (d) A model that may be employed to enhance the quality of data developed or collected, the analyses that can be completed in future assessments to identify specific program or classroom effects using this data, and a practitioner's guide on measurement and statistics to improve dissemination of results obtained from SI or educational programs.