GSE/SGER: Characterizing Broader Impacts: An Exploratory Study of Metrics and Measures for the Research on Gender in Science and Engineering Program

这项探索性研究为描述美国国家科学基金会（NSF）科学与工程项目中性别研究（GSE）的广泛影响迈出了第一步。将对GSE资助的研究和产品进行审查，以确定用于性别研究和作为变化指标的指标和措施。与主要研究人员和GSE项目官员的面谈将产生一个用于评估的良好的逻辑模型和一组基准。对更广泛的影响的措施的建议，可能捕获研究、传播和推广服务项目之间预期的相互作用，将从紧急计划逻辑中得出。最后，将编写一份报告，阐述为三个GSE项目组成部分确定的更广泛的影响措施和指标，将评估逻辑模型组成部分与美国国家科学基金会的战略目标和现有的国家数据联系起来，这些数据构成了科学和工程领域性别研究的背景。该建议的智力优点包括对可用于捕获GSE学习社区贡献者之间动态交互的度量和度量的强调。探索各种指标，询问如何捕捉逻辑模型组件之间联系的本质，以及GSE计划的短期和长期“更广泛的影响”也是新颖的，处于测量研究的前沿。透过本研究，我们将找出内隐的行动理论、潜在的评估逻辑，以及相关的衡量标准与措施。拟议的首席研究员（PI）和受资助组织在汇集大规模数据资源的知识方面具有优势，可以对探索性研究所需的定量和定性见解进行三角测量。在测量和评估方面的一些经验来自于以前成功完成的NSF-EHR项目的评估。本研究的广泛影响将通过提供可能适合其工作的措施、方案和工具的重点审查和注释清单，为主要研究人员提供信息。通过阐明评估逻辑模型和相应的内隐行为理论，GSE研究人员将受益于识别知识缺口和可测试的假设。最后，项目官员、政策制定者和公众将受益于在评估联邦资助项目的广泛影响时使用的一系列可能的措施。

This exploratory research study takes a first step toward characterizing measures of the broader impacts for the Research on Gender in Science and Engineering Program (GSE) at the National Science Foundation (NSF). A review of the GSE funded studies and products will be conducted to identify metrics and measures that are used in research on gender and as indicators of change. A well articulated logic model for evaluation and a set of benchmarks will result from interviews with principal investigators and the GSE program officer. Recommendations for measures of broader impact that may capture the intended interactions between research, dissemination, and extension service projects will be derived from the emergent program logic. Finally, a report of the broader impact measures and metrics identified for each of the three GSE Program components will be prepared, linking the evaluation logic model components to the strategic goals of NSF and to existing national data that frame the context for research on gender in science and engineering. The intellectual merits of this proposal include the emphasis on metrics and measures that may be used to capture the dynamic interactions among contributors to the GSE learning community. Exploring various indicators and asking how to capture the nature of links between logic model components as well as the short and long term "broader impacts" of the GSE Program are also novel and on the cutting edge of measurement research. Through this study, implicit theories of action, underlying evaluation logic, and relevant metrics and measures will be identified. The proposed principal investigator (PI) and grantee organization bring strengths in drawing together knowledge of large scale data resources to triangulating quantitative and qualitative insights necessary for exploratory research. Some of this experience in measurement and evaluation has come from previous and successfully completed evaluations of NSF-EHR programs. The broader impacts of this study will inform principal investigators by providing a focused review and annotated inventory of measures, protocols, and instruments that may be appropriate for their work. GSE researchers will benefit from the identification of knowledge gaps and testable assumptions that result from articulating the evaluation logic model and corresponding implicit theories of action. Finally, program officers, policy-makers, and the public will benefit by having an array of possible measures to use in evaluating the broader impacts of federally funded programs.