Why the Rankings Are Wrong: Lessons from Data Underlying U.K. University League Tables

Saved in:
Bibliographic Details
Title: Why the Rankings Are Wrong: Lessons from Data Underlying U.K. University League Tables
Language: English
Authors: J. Paul Grayson, Kyle Grayson
Source: Canadian Journal of Higher Education. 2026 56(1):35-54.
Availability: Canadian Society for the Study of Higher Education. P.O. Box 34091, RPO Fort Richmond, Winnipeg, MB R3T 5T5, Canada. Tel: 204-474-6404; Fax: 204-474-7561; e-mail: csshe@cc.umanitoba.ca; Web site: www.cjhe-rces.ca
Peer Reviewed: Y
Page Count: 20
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Foreign Countries, Universities, Achievement Rating, Reputation, Misconceptions, Validity, Institutional Evaluation, Educational Quality, Evaluation Criteria, Student Surveys, Educational Research, Value Added Models
Geographic Terms: United Kingdom, Canada
ISSN: 0316-1218
Abstract: This article uses high-quality data from the United Kingdom to critically examine the assumptions underpinning university league tables in Canada and elsewhere. Particular attention is given to research quality and value added in learning (VA). Unlike many global ranking systems, U.K. rankings incorporate measures that allow for robust assessment. Based on these data, we show that league table positions in the United Kingdom are weakly associated with research quality and largely unrelated to VA. Furthermore, research funding bears little consistent relationship to research quality. At both institutional and departmental levels, notably in Politics and International Studies, highly ranked universities do not necessarily deliver superior learning outcomes or research quality. These findings challenge the validity of using inputs such as research grants or student awards as proxies for institutional quality. Although U.K. data cannot be generalized automatically, they provide a valuable reference point for other countries. As a result of these findings, we argue that Canadian rankings, and others like them, must be treated with considerable skepticism.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1504239
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHLCW30plMb10RFHlT8e5VzAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDE9xbeOjrEB3iDkSBAIBEICBm1CsCf8TFujbnAHmlWOxg3tW6O3I5JVfd56cOk9X8fSFZpt8j5F0vbZkSbNiCkT1jHM_TyujrwcBYPXNU1lvFAWq7OhIfD2dsHSajz7oCPAk2YLDptkQfQJxW9X3wy0s-W70KLfLIipKo8wBTBZY_GXnCByNWKwqlBnw_EjulqQhx5FgbkBcZoDszKYaYOnJxgGzzvK93zenF19u
Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1504239
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1504239
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Why the Rankings Are Wrong: Lessons from Data Underlying U.K. University League Tables
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22J%2E+Paul+Grayson%22">J. Paul Grayson</searchLink><br /><searchLink fieldCode="AR" term="%22Kyle+Grayson%22">Kyle Grayson</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Canadian+Journal+of+Higher+Education%22"><i>Canadian Journal of Higher Education</i></searchLink>. 2026 56(1):35-54.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Canadian Society for the Study of Higher Education. P.O. Box 34091, RPO Fort Richmond, Winnipeg, MB R3T 5T5, Canada. Tel: 204-474-6404; Fax: 204-474-7561; e-mail: csshe@cc.umanitoba.ca; Web site: www.cjhe-rces.ca
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 20
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Universities%22">Universities</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Rating%22">Achievement Rating</searchLink><br /><searchLink fieldCode="DE" term="%22Reputation%22">Reputation</searchLink><br /><searchLink fieldCode="DE" term="%22Misconceptions%22">Misconceptions</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Institutional+Evaluation%22">Institutional Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Quality%22">Educational Quality</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Criteria%22">Evaluation Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Surveys%22">Student Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Value+Added+Models%22">Value Added Models</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22United+Kingdom%22">United Kingdom</searchLink><br /><searchLink fieldCode="DE" term="%22Canada%22">Canada</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0316-1218
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This article uses high-quality data from the United Kingdom to critically examine the assumptions underpinning university league tables in Canada and elsewhere. Particular attention is given to research quality and value added in learning (VA). Unlike many global ranking systems, U.K. rankings incorporate measures that allow for robust assessment. Based on these data, we show that league table positions in the United Kingdom are weakly associated with research quality and largely unrelated to VA. Furthermore, research funding bears little consistent relationship to research quality. At both institutional and departmental levels, notably in Politics and International Studies, highly ranked universities do not necessarily deliver superior learning outcomes or research quality. These findings challenge the validity of using inputs such as research grants or student awards as proxies for institutional quality. Although U.K. data cannot be generalized automatically, they provide a valuable reference point for other countries. As a result of these findings, we argue that Canadian rankings, and others like them, must be treated with considerable skepticism.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1504239
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1504239
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 35
    Subjects:
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Universities
        Type: general
      – SubjectFull: Achievement Rating
        Type: general
      – SubjectFull: Reputation
        Type: general
      – SubjectFull: Misconceptions
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Institutional Evaluation
        Type: general
      – SubjectFull: Educational Quality
        Type: general
      – SubjectFull: Evaluation Criteria
        Type: general
      – SubjectFull: Student Surveys
        Type: general
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Value Added Models
        Type: general
      – SubjectFull: United Kingdom
        Type: general
      – SubjectFull: Canada
        Type: general
    Titles:
      – TitleFull: Why the Rankings Are Wrong: Lessons from Data Underlying U.K. University League Tables
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: J. Paul Grayson
      – PersonEntity:
          Name:
            NameFull: Kyle Grayson
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 0316-1218
          Numbering:
            – Type: volume
              Value: 56
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Canadian Journal of Higher Education
              Type: main
ResultId 1