REF 2014: winners and losers in 'intensity' ranking

Alternative ranking of REF results maps university performance against the proportion of eligible staff submitted.

ʮ�� 19, 2014

Twitter:

REF 2014 research intensity ranking - click here

Queen��s University Belfast and Brunel and Loughborough universities are three of the biggest winners when their quality scores in the research excellence framework are weighted for research intensity.

All three universities rank relatively low down among research-intensives when institutions are ranked solely on the basis of the standard grade point average of their REF results (see the methodology here for an explanation of GPA).

But when GPA is multiplied by the fraction of eligible staff submitted by each institution, these three universities rise up at least 30 places, having submitting relatively high proportions of their staff.

Queen��s University Belfast rises highest, from joint 42nd to joint eighth.

Notable institutions to fall away from the upper ranks on this score include Queen Mary University of London, down from joint 11th to joint 34th, and Cardiff University, down from 6th to 50th.

Figures on the proportion of eligible staff submitted are calculated by dividing the number submitted �C reported by the �й�AƬ Funding Council for England �C by the number eligible to be submitted �C supplied by the �й�AƬ Statistics Agency.

The latter figures were unavailable when Times �й�AƬ went to press with its main rankings, which use GPA and ��research power�� as the primary indicators.

paul.jump@tesglobal.com

�Ķ��

�Ķ��:&�Բ��;

Research Excellence Framework

��ļ�

REF 'intensity' table

REF 'intensity' table

��ע��ټ��

Ϊ��Ҫע�᣿

ע��ѵģ��ʮ�ֱ��
ע��ɹ��ÿ�¿��Ķ�3ƪ��
��ǵ��ʼ�

��

��Ķ�Ȩ��:

��Ķ��š��۵㡢��
��Ӱ汾
̩��ʿ�ߵȽ��ѧ��ĵ��Ӱ汾

��

Please or to read this article.

Reader's comments (9)

#1 Submitted by ggilestro on ʮ�� 19, 2014 - 2:57pm

Thank you for updating this, I guess. If we really have to play the ranking game, this is the only way to play it. All of the other information based on GPA alone is just propaganda really.

#2 Submitted by ThomasLange on ʮ�� 20, 2014 - 12:48am

A very helpful update indeed. GPA rankings on their own are pretty meaningless and only help those places who thought they should be "gaming" the scores.. Research Power/Intensity displays a much more meaningful story and should arguably be used exclusively for future rounds when results are being reported. Will the Intensity rankings also be made available at subject/UoA level?

#3 Submitted by Fanis on ʮ�� 20, 2014 - 4:21am

I have just written in expectation of these tables. Will Times �й�AƬ be able to produce them by Unit of Assessment as well? https://fanismissirlis.wordpress.com/2014/12/19/qmulref2014/

#4 Submitted by Fanis on ʮ�� 20, 2014 - 4:29am

Is Queen's University Belfast or Queen Mary University of London depicted as a Queen bee in the photo?

#5 Submitted by David Bignell on ʮ�� 20, 2014 - 9:21am

Surely the photo illustrates a typical university administration: a queen bee surrounded by drones! Now that the gaming element is so obvious in many of the REF outcomes, I am surprised it was ever allowed in the first place. But consider the following message from an anomymous head of department to his colleagues, in an anonymous UK university: "It is true that the REF is in principle an "institutional game", which in our case resulted in about two thirds of our staff having been returned. However, I find it important to stress that this is an accomplishment of the whole department, i.e., ALL academic staff, no matter whether or not you have been returned as an individual researcher. The research performance of the department is very much dependent on our long term internal culture, the way we treat, respect and collaborate with each other. And this is exactly what I think we are doing right. Because everyone is part of that, I hope that all of you feel proud of our REF achievement." Now that is true enlightenment. And how rare these days.

#6 Submitted by NickStone on ʮ�� 21, 2014 - 11:35am

On the basis that the GPA figures can and are easily manipulated, why does the TES allow these unrepresentative figures be released for general consumption and use by many for years to come?

#7 Submitted by W.Speedway on ʮ�� 22, 2014 - 3:21pm

Notably most HEIs are only about half a GPA percentage point below the very best, presumably largely achieved on shoestring budgets for many. Perhaps the forthcoming REF funding allocations should thus primarily focus on further improvement of quality, and raising the number of UoAs and eligible staff across the board. To this end possibly the top few units having developed robustness could upgrade to self funding collaborative research institutes, serving as agents for inward FDI to the UK.

#8 Submitted by Stephen Elliott on һ�� 2, 2015 - 10:31pm

There is a very simple explanation for movements such as Queens University (upwards) from joint 42nd to joint 8th, and Cardiff (downwards) from 6th to 50th. Both measures (GPA and GPA multiplied by a ratio) are meaningless. Simple arithmetic is inadmissable in respect of the REF's four level scale because that scale is merely ordinal (at best). Moreover, if one reads the first chapter of Alasdair MacIntyre's "After Virtue," one can see that the REF ordinal scale cannot be approximated to an underlying "quantifiable" interval scale. Incredibly, the missing ingredient is teaching (see Andrew Warwick's "Masters of Theory: Cambridge and the rise of Mathematical Physics") . This argument is set out in greater depth at www.paceni.wordpress.com. Or Google "Lies Damn Lies and the Research Excellence Framework"

#9 Submitted by daver on һ�� 2, 2015 - 11:16pm

Thank you for that comment Stephen Elliot, it needed to be said. Even accepting some sort of numerical scale can be applied I have been slightly puzzled by the assumption that the grade point averages are calculated in a linear way instead of by the non-linear funding formula.

�й�AƬ