The Worst Performance Rule, or the Not-Best Performance Rule? Latent-Variable Analyses of Working Memory Capacity, Mind-Wandering Propensity, and Reaction Time

Saved in:
Bibliographic Details
Title: The Worst Performance Rule, or the Not-Best Performance Rule? Latent-Variable Analyses of Working Memory Capacity, Mind-Wandering Propensity, and Reaction Time
Authors: Welhaf, Matthew S., Smeekens, Bridget A., Meier, Matt E. (ORCID 0000-0003-2002-191X), Silvia, Paul J. (ORCID 0000-0003-4597-328X), Kwapil, Thomas R. (ORCID 0000-0003-1116-5954), Kane, Michael J.
Source: Journal of Intelligence. 2020 8.
Availability: MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: indexing@mdpi.com; e-mail: jintelligence@mdpi.com; Web site: https://www.mdpi.com/journal/jintelligence
Peer Reviewed: Y
Page Count: 23
Publication Date: 2020
Sponsoring Agency: National Institute of Mental Health (NIMH) (DHHS/NIH)
Contract Number: R15MH093771
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Short Term Memory, Attention, Reaction Time, Performance, Cognitive Ability, Undergraduate Students
Geographic Terms: North Carolina (Greensboro)
ISSN: 2079-3200
Abstract: The worst performance rule (WPR) is a robust empirical finding reflecting that people's worst task performance shows numerically stronger correlations with cognitive ability than their average or best performance. However, recent meta-analytic work has proposed this be renamed the "not-best performance" rule because mean and worst performance seem to predict cognitive ability to similar degrees, with both predicting ability better than best performance. We re-analyzed data from a previously published latent-variable study to test for worst vs. not-best performance across a variety of reaction time tasks in relation to two cognitive ability constructs: working memory capacity (WMC) and propensity for task-unrelated thought (TUT). Using two methods of assessing worst performance--ranked-binning and ex-Gaussian-modeling approaches--we found evidence for both the worst and not-best performance rules. WMC followed the not-best performance rule (correlating equivalently with mean and longest response times (RTs)) but TUT propensity followed the worst performance rule (correlating more strongly with longest RTs). Additionally, we created a mini-multiverse following different outlier exclusion rules to test the robustness of our findings; our findings remained stable across the different multiverse iterations. We provisionally conclude that the worst performance rule may only arise in relation to cognitive abilities closely linked to (failures of) sustained attention.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1322589
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1322589
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1322589
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Worst Performance Rule, or the Not-Best Performance Rule? Latent-Variable Analyses of Working Memory Capacity, Mind-Wandering Propensity, and Reaction Time
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Welhaf%2C+Matthew+S%2E%22">Welhaf, Matthew S.</searchLink><br /><searchLink fieldCode="AR" term="%22Smeekens%2C+Bridget+A%2E%22">Smeekens, Bridget A.</searchLink><br /><searchLink fieldCode="AR" term="%22Meier%2C+Matt+E%2E%22">Meier, Matt E.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2002-191X">0000-0003-2002-191X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Silvia%2C+Paul+J%2E%22">Silvia, Paul J.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4597-328X">0000-0003-4597-328X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Kwapil%2C+Thomas+R%2E%22">Kwapil, Thomas R.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1116-5954">0000-0003-1116-5954</externalLink>)<br /><searchLink fieldCode="AR" term="%22Kane%2C+Michael+J%2E%22">Kane, Michael J.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Intelligence%22"><i>Journal of Intelligence</i></searchLink>. 2020 8.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: indexing@mdpi.com; e-mail: jintelligence@mdpi.com; Web site: https://www.mdpi.com/journal/jintelligence
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2020
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Institute of Mental Health (NIMH) (DHHS/NIH)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R15MH093771
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Short+Term+Memory%22">Short Term Memory</searchLink><br /><searchLink fieldCode="DE" term="%22Attention%22">Attention</searchLink><br /><searchLink fieldCode="DE" term="%22Reaction+Time%22">Reaction Time</searchLink><br /><searchLink fieldCode="DE" term="%22Performance%22">Performance</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Ability%22">Cognitive Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22North+Carolina+%28Greensboro%29%22">North Carolina (Greensboro)</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2079-3200
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The worst performance rule (WPR) is a robust empirical finding reflecting that people's worst task performance shows numerically stronger correlations with cognitive ability than their average or best performance. However, recent meta-analytic work has proposed this be renamed the "not-best performance" rule because mean and worst performance seem to predict cognitive ability to similar degrees, with both predicting ability better than best performance. We re-analyzed data from a previously published latent-variable study to test for worst vs. not-best performance across a variety of reaction time tasks in relation to two cognitive ability constructs: working memory capacity (WMC) and propensity for task-unrelated thought (TUT). Using two methods of assessing worst performance--ranked-binning and ex-Gaussian-modeling approaches--we found evidence for both the worst and not-best performance rules. WMC followed the not-best performance rule (correlating equivalently with mean and longest response times (RTs)) but TUT propensity followed the worst performance rule (correlating more strongly with longest RTs). Additionally, we created a mini-multiverse following different outlier exclusion rules to test the robustness of our findings; our findings remained stable across the different multiverse iterations. We provisionally conclude that the worst performance rule may only arise in relation to cognitive abilities closely linked to (failures of) sustained attention.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1322589
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1322589
RecordInfo BibRecord:
  BibEntity:
    PhysicalDescription:
      Pagination:
        PageCount: 23
    Subjects:
      – SubjectFull: Short Term Memory
        Type: general
      – SubjectFull: Attention
        Type: general
      – SubjectFull: Reaction Time
        Type: general
      – SubjectFull: Performance
        Type: general
      – SubjectFull: Cognitive Ability
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: North Carolina (Greensboro)
        Type: general
    Titles:
      – TitleFull: The Worst Performance Rule, or the Not-Best Performance Rule? Latent-Variable Analyses of Working Memory Capacity, Mind-Wandering Propensity, and Reaction Time
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Welhaf, Matthew S.
      – PersonEntity:
          Name:
            NameFull: Smeekens, Bridget A.
      – PersonEntity:
          Name:
            NameFull: Meier, Matt E.
      – PersonEntity:
          Name:
            NameFull: Silvia, Paul J.
      – PersonEntity:
          Name:
            NameFull: Kwapil, Thomas R.
      – PersonEntity:
          Name:
            NameFull: Kane, Michael J.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2020
          Identifiers:
            – Type: issn-electronic
              Value: 2079-3200
          Numbering:
            – Type: volume
              Value: 8
          Titles:
            – TitleFull: Journal of Intelligence
              Type: main
ResultId 1