Pitfalls in aggregating performance measures in higher education
Pitfalls in aggregating performance measures in higher education
复制标题
DOI：
10.1080/03075079.2014.914912
复制
发表时间：
2016-01-02
影响因子：
4.2
通讯作者：
de Rassenfosse, Gaetan
中科院分区：
文献类型：
--
作者：
Williams, Ross;de Rassenfosse, Gaetan
大学的国家和国际排名现在是高等教育领域公认的一部分。排名将不同的绩效指标汇总到一个单一的量表中，因此取决于用于汇总的方法和权重。最常见的方法是在聚合之前相对于最高性能实体缩放每个变量。其他方法涉及转换数据以允许变量的不同分布。本文以《泰晤士报高等教育》和上海交通大学排名以及U21国家高等教育体系排名为例，评估了替代方法和权重敏感性。作者的结论是，转换数据云解释;所包含变量的选择比赋予它们的权重更重要;将排名扩展到大量大学/国家存在局限性。
National and international rankings of universities are now an accepted part of the higher education landscape. Rankings aggregate different performance measures into a single scale and therefore depend on the methods and weights used to aggregate. The most common method is to scale each variable relative to the highest performing entity prior to aggregating. Other approaches involve transforming the data to allow for the different spread of the variables. This paper evaluates alternative methods and the sensitivity to weights with illustrations from the Times Higher Education and Shanghai Jiao Tong rankings of universities and the U21 rankings of national systems of higher education. The authors conclude that transforming the data clouds interpretation; the choice of included variables is more important than the weights attached to them; and there are limitations in extending ranking to a large number of universities/countries.