Lessons-Learned from GSE Extension Services Grantees, 2005-2009

2005-2009 年 GSE 推广服务受助者的经验教训

• 批准号: 0938413
• 负责人: Yolanda Comedy
• 金额: $ 9.29万
• 依托单位: American Association for the Advancement of Science
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-09-01 至 2014-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0938413&HistoricalAwards=false
• 关键词: Lessons; Learned; GSE; Extension; Services

Intellectual Merit: The American Association for the Advancement of Science (AAAS) Center for Advancing Science & Engineering Capacity will review experience with the Extension Services (EXT) component of the NSF Research on Gender in Science and Engineering (GSE) program. The purpose of the review is to compile lessons-learned among all project cohorts since 2005 and evaluate how the intended concept translated into field experience. Extension Services grantees are awarded up to $2.5 million over five years, a large investment for a relatively small program budget. The first two projects funded have passed a three and a half-year mark. Collectively seven projects represent over 17 years of experience in the field, testing the concept of this particular investment (each for five years).EXT projects are engaged in the process of changing educational values, practice, and knowledge, a process that is neither linear nor predictable. Models for assessing the success of new initiatives range from short and expedient, e.g. briefings, to formal, comprehensive evaluation of outcomes. As new initiatives, EXT's lack a standard template or control for gauging success. Periodically assessing lessons-learned is one approach for doing so. The proposed work is exploratory in combining methods of evaluation research (formal outcomes measurement), systems analysis (review and documentation of organizational processes and functions in a consistent manner), management review (leaders describe their experience), journalistic reporting (interesting stories and facts), and anthropology (how people explain what they are doing in situ). The method is inherently novel, interdisciplinary, and pragmatic. Among key inputs are interviews with project managers, project documentation, reports and reviews gathered via the third-year reverse site visit, analysis of the concept as articulated in annual program announcements, and interviews with the NSF Program Director. Interviews with grantees will employ an Interview Guide Approach (per the Kellogg Foundation Evaluation Handbook). The goal is to develop an overview of how the lead EXT teams interpreted the solicitation with guidance from the Program Director, how they designed their version of an Extension Service, and what happened when they confronted the realities of implementation. Interviews will be conducted by staff of the AAAS Capacity Center, who are experienced in multiple methods among those cited above, especially evaluation theory and methods, and who are familiar with NSF's objectives and operations, the GSE program, the community of practice and the knowledge base related to issues of women in S&E, and who have personally produced many similar reports for university, corporate, and federal clients. Broader Impacts: Lessons-learned about GSE's Extension Services will potentially enable the program to refine the solicitation, guiding new teams toward productive strategies in organizing their services and reaching various communities not currently participating. To the extent certain kinds of EXT events and relationships are found to be promising, they might be adapted elsewhere. Lessons-learned is not a substitute for rigorous formal project or program evaluation; it is expedient and pragmatic in real time, elucidating what is useful to others and NSF as "field experience," capturing significant experience as these large-scale projects evolve. Taken together, these lessons constitute a portfolio assessment of projects that can guide current and future performers as well as NSF management.

智力优势：美国科学促进会(AAAS)科学与工程能力提升中心将审查NSF科学与工程性别研究(GSE)计划中推广服务(EXT)部分的经验。审查的目的是汇编自2005年以来在所有项目群中吸取的经验教训，并评价预期的概念如何转化为实地经验。扩展服务获得者将在五年内获得高达250万美元的奖励，对于相对较小的计划预算来说，这是一笔巨大的投资。获得资助的前两个项目已经超过了三年半的大关。共有7个项目代表了该领域17年以上的经验，检验了这一特定投资的概念(每个项目为期5年)。EXT项目参与了改变教育价值观、实践和知识的过程，这一过程既不是线性的，也不是可预测的。评估新举措成功的模式从简短和便利的情况介绍，到正式、全面的成果评估。作为新的举措，EXT缺乏衡量成功的标准模板或控制。定期评估吸取的教训是这样做的一种方法。拟议的工作在结合评价研究(正式成果衡量)、系统分析(以一致的方式审查和记录组织流程和职能)、管理审查(领导人描述他们的经验)、新闻报道(有趣的故事和事实)和人类学(人们如何解释他们在现场做什么)的方法方面是探索性的。这种方法本质上是新颖的、跨学科的和务实的。其中关键的投入包括对项目经理的访谈、项目文档、通过第三年反向现场访问收集的报告和审查、对年度计划公告中阐明的概念的分析，以及对NSF计划主任的采访。对受赠人的面试将采用面试指南的方法(根据凯洛格基金会评估手册)。目标是概述牵头外部团队如何在方案主任的指导下解释招标，他们如何设计他们版本的扩展服务，以及当他们面对实施的现实时发生了什么。访谈将由美国科学促进会能力中心的工作人员进行，他们在以上提到的方法中具有多种方法的经验，特别是评估理论和方法，熟悉国家科学基金会的目标和操作、政府支持企业计划、实践社区和S妇女问题的知识库，并亲自为大学、企业和联邦客户编写过许多类似报告。更广泛的影响：从GSE的扩展服务中学到的经验教训将可能使该计划能够改进征集，指导新的团队在组织他们的服务和接触到目前尚未参与的各个社区方面采取富有成效的战略。在某种程度上，某些类型的EXT事件和关系被发现是有希望的，它们可能会被改编到其他地方。总结经验不能替代严格的正式项目或计划评估；它是权宜之计和实时务实的，它阐明了什么是对其他人和NSF有用的“实地经验”，随着这些大型项目的发展，获取了重要的经验。综上所述，这些经验教训构成了对项目的组合评估，可以指导当前和未来的执行者以及NSF管理层。