GSE/SGER: Characterizing Broader Impacts: An Exploratory Study of Metrics and Measures for the Research on Gender in Science and Engineering Program

这项探索性研究研究是确定国家科学基金会(NSF)科学与工程性别研究(GSE)更广泛影响的措施的第一步。将对GSE资助的研究和产品进行审查，以确定用于性别研究和作为变化指标的衡量标准和措施。与主要调查人员和GSE项目官员的面谈将产生一个清晰的评估逻辑模型和一套基准。对可能捕捉研究、传播和推广服务项目之间的预期交互作用的更广泛影响的度量的建议将从紧急计划逻辑中得出。最后，将编写一份报告，说明为全球环境教育计划的三个组成部分确定的更广泛的影响措施和衡量标准，将评价逻辑模型组成部分与国家科学基金会的战略目标和现有的国家数据联系起来，这些数据为科学和工程领域的性别研究奠定了基础。这一建议的学术价值包括强调可用于捕捉GSE学习社区贡献者之间的动态交互的指标和衡量标准。探索各种指标，询问如何捕捉逻辑模型组件之间的联系的本质，以及GSE计划的短期和长期“更广泛的影响”，也是测量研究的创新和前沿。通过这项研究，将确定隐含的行动理论，潜在的评估逻辑，以及相关的衡量标准和衡量标准。拟议的首席调查员(PI)和受赠人组织将在收集大规模数据资源的知识方面发挥优势，以三角测量探索性研究所需的定量和定性见解。其中一些测量和评估的经验来自于之前对NSF-EHR项目的成功完成的评估。这项研究的更广泛影响将通过提供对可能适合他们工作的措施、方案和工具的重点审查和带注释的清单来向主要调查人员提供信息。GSE研究人员将受益于通过阐明评估逻辑模型和相应的隐含行动理论来识别知识差距和可测试的假设。最后，项目官员、政策制定者和公众将受益于拥有一系列可能的措施来评估联邦资助项目的更广泛影响。

This exploratory research study takes a first step toward characterizing measures of the broader impacts for the Research on Gender in Science and Engineering Program (GSE) at the National Science Foundation (NSF). A review of the GSE funded studies and products will be conducted to identify metrics and measures that are used in research on gender and as indicators of change. A well articulated logic model for evaluation and a set of benchmarks will result from interviews with principal investigators and the GSE program officer. Recommendations for measures of broader impact that may capture the intended interactions between research, dissemination, and extension service projects will be derived from the emergent program logic. Finally, a report of the broader impact measures and metrics identified for each of the three GSE Program components will be prepared, linking the evaluation logic model components to the strategic goals of NSF and to existing national data that frame the context for research on gender in science and engineering. The intellectual merits of this proposal include the emphasis on metrics and measures that may be used to capture the dynamic interactions among contributors to the GSE learning community. Exploring various indicators and asking how to capture the nature of links between logic model components as well as the short and long term "broader impacts" of the GSE Program are also novel and on the cutting edge of measurement research. Through this study, implicit theories of action, underlying evaluation logic, and relevant metrics and measures will be identified. The proposed principal investigator (PI) and grantee organization bring strengths in drawing together knowledge of large scale data resources to triangulating quantitative and qualitative insights necessary for exploratory research. Some of this experience in measurement and evaluation has come from previous and successfully completed evaluations of NSF-EHR programs. The broader impacts of this study will inform principal investigators by providing a focused review and annotated inventory of measures, protocols, and instruments that may be appropriate for their work. GSE researchers will benefit from the identification of knowledge gaps and testable assumptions that result from articulating the evaluation logic model and corresponding implicit theories of action. Finally, program officers, policy-makers, and the public will benefit by having an array of possible measures to use in evaluating the broader impacts of federally funded programs.