GSE/SGER: Characterizing Broader Impacts: An Exploratory Study of Metrics and Measures for the Research on Gender in Science and Engineering Program

这项探索性研究迈出了第一步，为国家科学基金会（NSF）的科学和工程方案（GSE）中的性别研究确定了更广泛的影响。将对两性平等研究所资助的研究和产品进行审查，以确定用于两性平等研究和作为变化指标的衡量标准和措施。一个清晰的评估逻辑模型和一套基准将来自与主要调查人员和GSE项目官员的访谈。建议的措施，更广泛的影响，可能会捕捉研究，传播和推广服务项目之间的预期互动，将来自紧急计划的逻辑。最后，将编写一份报告，介绍为三个GSE计划组成部分中的每一个确定的更广泛的影响措施和指标，将评估逻辑模型组成部分与NSF的战略目标和现有的国家数据联系起来，这些数据构成了科学和工程领域性别研究的背景。这一建议的智力价值包括强调可用于捕捉GSE学习社区贡献者之间动态互动的指标和措施。探索各种指标，并询问如何捕捉逻辑模型组件之间的联系的性质，以及短期和长期的“更广泛的影响”的GSE计划也是新颖的，在测量研究的前沿。通过这项研究，内隐理论的行动，基本的评估逻辑，以及相关的指标和措施将被确定。拟议的首席研究员（PI）和受资助组织在汇集大规模数据资源的知识方面发挥了优势，以三角测量探索性研究所需的定量和定性见解。在测量和评估方面的一些经验来自于以前成功完成的NSF-EHR项目评估。这项研究的更广泛影响将通过提供一个有重点的审查和注释的措施，协议和文书，可能适合他们的工作清单通知主要研究人员。GSE研究人员将受益于知识差距的识别和可检验的假设，从阐述评估逻辑模型和相应的隐含的行动理论。最后，项目官员、政策制定者和公众将受益于一系列可能的措施，用于评估联邦资助项目的更广泛影响。

This exploratory research study takes a first step toward characterizing measures of the broader impacts for the Research on Gender in Science and Engineering Program (GSE) at the National Science Foundation (NSF). A review of the GSE funded studies and products will be conducted to identify metrics and measures that are used in research on gender and as indicators of change. A well articulated logic model for evaluation and a set of benchmarks will result from interviews with principal investigators and the GSE program officer. Recommendations for measures of broader impact that may capture the intended interactions between research, dissemination, and extension service projects will be derived from the emergent program logic. Finally, a report of the broader impact measures and metrics identified for each of the three GSE Program components will be prepared, linking the evaluation logic model components to the strategic goals of NSF and to existing national data that frame the context for research on gender in science and engineering. The intellectual merits of this proposal include the emphasis on metrics and measures that may be used to capture the dynamic interactions among contributors to the GSE learning community. Exploring various indicators and asking how to capture the nature of links between logic model components as well as the short and long term "broader impacts" of the GSE Program are also novel and on the cutting edge of measurement research. Through this study, implicit theories of action, underlying evaluation logic, and relevant metrics and measures will be identified. The proposed principal investigator (PI) and grantee organization bring strengths in drawing together knowledge of large scale data resources to triangulating quantitative and qualitative insights necessary for exploratory research. Some of this experience in measurement and evaluation has come from previous and successfully completed evaluations of NSF-EHR programs. The broader impacts of this study will inform principal investigators by providing a focused review and annotated inventory of measures, protocols, and instruments that may be appropriate for their work. GSE researchers will benefit from the identification of knowledge gaps and testable assumptions that result from articulating the evaluation logic model and corresponding implicit theories of action. Finally, program officers, policy-makers, and the public will benefit by having an array of possible measures to use in evaluating the broader impacts of federally funded programs.