Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund.
Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund.
复制标题
DOI：
10.9745/ghsp-d-20-00126
复制
发表时间：
2020-12-23
期刊：
影响因子：
--
通讯作者：
Gavi Full Country Evaluations Consortium; and Global Fund Prospective Country Evaluation Consortium
中科院分区：
文献类型：
--
作者：
Carnahan E;Gurley N;Asiimwe G;Chilundo B;Duber HC;Faye A;Kamya C;Mpanya G;Nagasha S;Phillips D;Salisbury N;Shearer J;Shelley K;Gavi Full Country Evaluations Consortium; and Global Fund Prospective Country Evaluation Consortium
从全球疫苗免疫联盟、疫苗联盟和全球艾滋病、结核病和疟疾基金的评价工作中吸取的经验教训，有助于为正在进行或今后进行的复杂干预措施评价的设计和实施提供信息。我们分享从7年多来在7个国家开展评价的经验中总结的5个教训。包括一个启动阶段，让利益攸关方参与，并为相关、有用的评价设计提供信息。或环境变化，并相应地调整评价结合具体情况提出建议，并清楚地传达这些建议的潜在优势，我们从7年来在7个国家实施评估的经验中总结出5个关键教训，其中包括：全球卫生倡议，特别是那些资助或实施复杂干预措施的倡议，应考虑嵌入评估，以了解这些方案如何以及为什么能够在必要时进行调整并最大限度地发挥影响。复杂干预措施的评价人员应继续分享在平衡利益攸关方优先事项、调整评价范围的“广度”和“深度”以及确保利用评价结果方面的经验教训。随着全球卫生方案变得越来越复杂，必须设计相应的评价，以评估这些方案的全部复杂性。全球疫苗和免疫联盟和全球基金已经委托进行了两次这样的评估，以使用前瞻性混合方法评估其投资的全方位。我们的目的是描述从执行这些评价中吸取的经验教训。本文综合介绍了Gavi和全球基金前瞻性混合方法评价的经验教训，每项评价都被视为案例研究。这些经验教训基于评价小组7年多（2013-2020年）来实施这些评价的经验。疾病控制和预防中心的公共卫生评价框架被用来确定经验教训。我们确定了5个经验教训，这些经验教训建立在现有的评价最佳做法的基础上，并包括实际和概念方面的综合考虑。这些经验教训涵盖了以下方面的重要性：（1）包括一个初始阶段，让利益攸关方参与进来，并为相关的、有用的评价设计提供信息;（2）在评价嵌入方案实施的程度上保持一致;（3）监测方案、组织或背景变化，并相应地调整评价;（4）聘用具有混合方法专业知识的评估人员，并使用有助于混合方法的工具和方法;（5）将建议置于背景中，并明确传达其潜在的证据力量。全球卫生倡议，特别是那些利用复杂干预措施的倡议，应考虑嵌入评估，以了解这些方案是如何以及为什么有效的。这些举措可以从这里介绍的经验教训中吸取教训，为设计和实施此类评价提供信息。
Lessons learned from implementing evaluations for Gavi, the Vaccine Alliance and the Global Fund for AIDS, Tuberculosis, and Malaria can help inform the design and implementation of ongoing or future evaluations of complex interventions. We share 5 lessons distilled from over 7 years of experience implementing evaluations in 7 countries. Including an inception phase to engage stakeholders and inform a relevant, useful evaluation design Aligning on the degree to which the evaluation is embedded in the program implementation Monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly Hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods Contextualizing recommendations and clearly communicating their underlying strength of evidence We present 5 key lessons distilled from 7 years of experience implementing evaluations in 7 countries, which include the importance of: Global health initiatives, particularly those funding or implementing complex interventions, should consider embedding evaluations to understand how and why the programs are working to adapt as necessary and maximize impact. Evaluators of complex interventions should continue to share lessons learned related to balancing stakeholder priorities, aligning on “breadth” versus “depth” of the evaluation scope and ensuring use of the evaluation findings. As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mixed-methods approach. We aim to describe lessons learned from implementing these evaluations. This article presents a synthesis of lessons learned based on the Gavi and Global Fund prospective mixed-methods evaluations, with each evaluation considered a case study. The lessons are based on the evaluation team’s experience from over 7 years (2013–2020) implementing these evaluations. The Centers for Disease Control and Prevention Framework for Evaluation in Public Health was used to ground the identification of lessons learned. We identified 5 lessons learned that build on existing evaluation best practices and include a mix of practical and conceptual considerations. The lessons cover the importance of (1) including an inception phase to engage stakeholders and inform a relevant, useful evaluation design; (2) aligning on the degree to which the evaluation is embedded in the program implementation; (3) monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly; (4) hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods; and (5) contextualizing recommendations and clearly communicating their underlying strength of evidence. Global health initiatives, particularly those leveraging complex interventions, should consider embedding evaluations to understand how and why the programs are working. These initiatives can learn from the lessons presented here to inform the design and implementation of such evaluations.