Valuing Different Perspectives - evaluation and evaluative knowledge

重视不同的观点 - 评价和评价知识

• 批准号: AH/L01310X/1
• 负责人: Peter Matthews
• 金额: $ 10.1万
• 依托单位: Heriot-Watt University
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2014
• 资助国家: 英国
• 起止时间: 2014 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=AH%2FL01310X%2F1
• 关键词: Valuing; Different; Perspectives; evaluation; evaluative

A central aim of the Connected Communities programme has been to carry out research with communities, not on communities. The AHRC are now keen to understand what the legacy of this investment in research with communities has been. The ambitious and complex nature of the resulting projects means there are significant challenges for attempts to evaluate legacy and whether they will be successful. The aim of this research will be to explore different approaches to evaluating projects and produce guidelines for future Connected Communities and similar projects. This will be carried out by delivering two evaluations of the same projects. One evaluation will be participatory, led by community partners; one will be academic-led. Academic- or expert-led evaluations, such as those common in the social sciences, provide many ways to find out "what works" or provides value-for-money - randomised controlled trials; large scale surveys; cost-benefit analysis; theories of change; realist evaluation etc. Such evaluations may involve the use of quantitative or qualitative methods that are defined, created, and analysed by academic researchers, often regarded as experts, but who may be removed from the communities themselves which have been subject to a policy or project. Importantly, the evaluation criteria are also set by the academic research team, typically before the research project has begun. The evaluator has the power to define whether something has been a "success" or "failure" which can have a long-lasting impact.In comparison, evaluations that are shaped and led by the community members at the heart of the projects are now increasingly used to assess the success and legacy of initiatives. These aim to capture the "local knowledge" of implementation and what was of value to the communities themselves. They respond to a concern that many of the softer outcomes of projects, that are often difficult to quantitatively measure, are not captured or even devalued by expert-led evaluations. Participatory evaluations aim to give communities the power to define "success" or "failure". This project, and the simultaneous evaluations at the heart of it, aims to explore these questions of power in the production of knowledge by asking what happens when community partners lead an evaluation and academics lead an evaluation of the same project. Are the research outputs produced different? And why might this be the case?To answer these questions, the project will run workshops to supplement the evaluations. Attended by community members and academics, the first will discuss the processes, commonalities, differences, values and limitations of the various evaluation approaches chosen. The second workshop will develop a series of evaluation guidelines suited for future community-based research. Rather than being a "toolkit", this will be an exploration of the different methods used in the different contexts and what worked, or did not work, and why. This will enable future projects to make better informed decisions as to what evaluation methods they might use when planning community projects. We cannot be prescriptive about the evaluation questions the community-led evaluation will ask. The academic evaluation will go back to original project briefs and align the original aims with the methods that the research team can use to ask whether the project has delivered what it set out to. The project also aims to explore the broader legacy of the Connected Communities programme. A key question in both evaluation sites will be the role of the AHRC as a funder of this type of activity and how this can be improved in future.

互联社区计划的核心目标是与社区一起开展研究，而不是针对社区。 AHRC 现在渴望了解这项社区研究投资的遗产是什么。由此产生的项目雄心勃勃且复杂，这意味着评估遗产以及它们是否会成功的尝试面临着重大挑战。这项研究的目的是探索评估项目的不同方法，并为未来的互联社区和类似项目制定指南。这将通过对同一项目进行两次评估来进行。一项评估将是参与性的，由社区合作伙伴领导；一个将以学术为主导。学术或专家主导的评估，例如社会科学中常见的评估，提供了多种方法来找出“什么有效”或提供物有所值的随机对照试验；大规模调查；成本效益分析；变革理论；此类评估可能涉及使用由学术研究人员定义、创建和分析的定量或定性方法，这些研究人员通常被视为专家，但可能会从受政策或项目约束的社区本身中剔除。重要的是，评估标准也是由学术研究团队设定的，通常是在研究项目开始之前。评估者有权定义某件事是“成功”还是“失败”，从而产生长期影响。相比之下，由项目核心社区成员制定和领导的评估现在越来越多地用于评估举措的成功和遗产。这些旨在获取实施的“当地知识”以及对社区本身有价值的内容。他们回应了这样一种担忧，即项目的许多较软的成果往往难以定量衡量，专家主导的评估没有捕捉到甚至贬低了其价值。参与式评估旨在赋予社区定义“成功”或“失败”的权力。该项目及其核心的同步评估旨在通过询问当社区合作伙伴主导评估和学者主导同一项目的评估时会发生什么，来探索知识生产中的权力问题。研究成果是否有所不同？为什么会出现这种情况？为了回答这些问题，该项目将举办研讨会来补充评估。第一场由社区成员和学者参加，将讨论所选择的各种评估方法的过程、共性、差异、价值和局限性。第二次研讨会将制定一系列适合未来社区研究的评估指南。这不是一个“工具包”，而是对不同环境下使用的不同方法的探索，以及哪些方法有效，哪些无效，以及原因。这将使未来的项目能够就规划社区项目时可能使用的评估方法做出更明智的决策。我们无法规定社区主导的评估将提出的评估问题。学术评估将回到最初的项目简介，并将最初的目标与研究团队可以用来询问项目是否达到预期目的的方法相结合。该项目还旨在探索互联社区计划的更广泛遗产。两个评估站点的一个关键问题是 AHRC 作为此类活动的资助者所扮演的角色以及未来如何改进这一角色。

项目成果

Social media, community development and social capital

社交媒体、社区发展和社会资本

• DOI: 10.1093/cdj/bsv040
• 发表时间: 2016
• 期刊: Community Development Journal
• 影响因子: 1.5
• 作者: Matthews P

Doing and evaluating community research - A process and outcomes approach for communities and researchers

进行和评估社区研究 - 社区和研究人员的过程和结果方法

• 发表时间: 2015
• 作者: Matthews, P

Engaging Wester Hailes - Findings from the Valuing Different Perspectives Community Evaluation.

参与 Wester Hailes - 从重视不同视角的社区评估中得出的结论。

• 发表时间: 2015
• 作者: Astbury, J

Valuing Academic Perspectives

重视学术观点

• 发表时间: 2015
• 作者: Matthews, P