Why the Rankings Are Wrong: Lessons from Data Underlying U.K. University League Tables

Saved in:
Bibliographic Details
Title: Why the Rankings Are Wrong: Lessons from Data Underlying U.K. University League Tables
Language: English
Authors: J. Paul Grayson, Kyle Grayson
Source: Canadian Journal of Higher Education. 2026 56(1):35-54.
Availability: Canadian Society for the Study of Higher Education. P.O. Box 34091, RPO Fort Richmond, Winnipeg, MB R3T 5T5, Canada. Tel: 204-474-6404; Fax: 204-474-7561; e-mail: csshe@cc.umanitoba.ca; Web site: www.cjhe-rces.ca
Peer Reviewed: Y
Page Count: 20
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Foreign Countries, Universities, Achievement Rating, Reputation, Misconceptions, Validity, Institutional Evaluation, Educational Quality, Evaluation Criteria, Student Surveys, Educational Research, Value Added Models
Geographic Terms: United Kingdom, Canada
ISSN: 0316-1218
Abstract: This article uses high-quality data from the United Kingdom to critically examine the assumptions underpinning university league tables in Canada and elsewhere. Particular attention is given to research quality and value added in learning (VA). Unlike many global ranking systems, U.K. rankings incorporate measures that allow for robust assessment. Based on these data, we show that league table positions in the United Kingdom are weakly associated with research quality and largely unrelated to VA. Furthermore, research funding bears little consistent relationship to research quality. At both institutional and departmental levels, notably in Politics and International Studies, highly ranked universities do not necessarily deliver superior learning outcomes or research quality. These findings challenge the validity of using inputs such as research grants or student awards as proxies for institutional quality. Although U.K. data cannot be generalized automatically, they provide a valuable reference point for other countries. As a result of these findings, we argue that Canadian rankings, and others like them, must be treated with considerable skepticism.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1504239
Database: ERIC
Description
Abstract:This article uses high-quality data from the United Kingdom to critically examine the assumptions underpinning university league tables in Canada and elsewhere. Particular attention is given to research quality and value added in learning (VA). Unlike many global ranking systems, U.K. rankings incorporate measures that allow for robust assessment. Based on these data, we show that league table positions in the United Kingdom are weakly associated with research quality and largely unrelated to VA. Furthermore, research funding bears little consistent relationship to research quality. At both institutional and departmental levels, notably in Politics and International Studies, highly ranked universities do not necessarily deliver superior learning outcomes or research quality. These findings challenge the validity of using inputs such as research grants or student awards as proxies for institutional quality. Although U.K. data cannot be generalized automatically, they provide a valuable reference point for other countries. As a result of these findings, we argue that Canadian rankings, and others like them, must be treated with considerable skepticism.
ISSN:0316-1218