Evaluating impact from research: A methodological framework
Evaluating impact from research: A methodological framework
复制标题
DOI：
10.1016/j.respol.2020.104147
复制
发表时间：
2021-01-08
期刊：
影响因子：
7.2
通讯作者：
Holden, J.
中科院分区：
文献类型：
--
作者：
Reed, M. S.;Ferre, M.;Holden, J.
背景资料：随着研究资助者越来越多地要求证明他们的投资带来了公共利益，对影响评估的兴趣迅速增长。目的：本文分析了文献，提供了研究影响和影响评估的新定义，开发了研究影响评估设计的类型学，并提出了一个方法框架，以指导对研究影响的意义和范围的评估。方法：一个适应扎根理论分析的研究影响评估框架来自跨学科的同行评议和灰色literature.Results：认识到影响的主观性质，因为他们被认为是由不同的群体在不同的时间，地点和文化，我们定义的研究影响评估的过程中评估的意义和达到的积极和消极的影响的研究。确定了五类影响评价设计，包括一系列评价方法和办法：一）实验和统计方法;二）文本、口头和艺术方法;三）系统分析方法;四）基于指标的办法;五）证据综合办法。我们的指导使影响评估设计能够适应评估的目标和背景，例如选择一种设计来建立一个必要的研究机构，（例如，许多因素中的一个重要因素）或充分（例如，唯一、直接）的影响原因，并为所评价的影响类型选择最适当的评价设计。使用拟议的定义，类型和方法框架，研究人员，资助者和其他利益相关者在多个学科工作可以选择一个合适的评价设计和方法，以证明任何学科的研究的影响。
Background: Interest in impact evaluation has grown rapidly as research funders increasingly demand evidence that their investments lead to public benefits.Aims: This paper analyses literature to provide a new definition of research impact and impact evaluation, develops a typology of research impact evaluation designs, and proposes a methodological framework to guide evaluations of the significance and reach of impact that can be attributed to research.Method: An adapted Grounded Theory Analysis of research impact evaluation frameworks drawn from cross-disciplinary peer-reviewed and grey literature.Results: Recognizing the subjective nature of impacts as they are perceived by different groups in different times, places and cultures, we define research impact evaluation as the process of assessing the significance and reach of both positive and negative effects of research. Five types of impact evaluation design are identified encompassing a range of evaluation methods and approaches: i) experimental and statistical methods; ii) textual, oral and arts-based methods; iii) systems analysis methods; iv) indicator-based approaches; and v) evidence synthesis approaches. Our guidance enables impact evaluation design to be tailored to the aims and context of the evaluation, for example choosing a design to establish a body of research as a necessary (e.g. a significant contributing factor amongst many) or sufficient (e.g. sole, direct) cause of impact, and choosing the most appropriate evaluation design for the type of impact being evaluated.Conclusion: Using the proposed definitions, typology and methodological framework, researchers, funders and other stakeholders working across multiple disciplines can select a suitable evaluation design and methods to evidence the impact of research from any discipline.