The Worst Performance Rule, or the Not-Best Performance Rule? Latent-Variable Analyses of Working Memory Capacity, Mind-Wandering Propensity, and Reaction Time

Saved in:
Bibliographic Details
Title: The Worst Performance Rule, or the Not-Best Performance Rule? Latent-Variable Analyses of Working Memory Capacity, Mind-Wandering Propensity, and Reaction Time
Authors: Welhaf, Matthew S., Smeekens, Bridget A., Meier, Matt E. (ORCID 0000-0003-2002-191X), Silvia, Paul J. (ORCID 0000-0003-4597-328X), Kwapil, Thomas R. (ORCID 0000-0003-1116-5954), Kane, Michael J.
Source: Journal of Intelligence. 2020 8.
Availability: MDPI AG. Klybeckstrasse 64, 4057 Basel, Switzerland. e-mail: indexing@mdpi.com; e-mail: jintelligence@mdpi.com; Web site: https://www.mdpi.com/journal/jintelligence
Peer Reviewed: Y
Page Count: 23
Publication Date: 2020
Sponsoring Agency: National Institute of Mental Health (NIMH) (DHHS/NIH)
Contract Number: R15MH093771
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Short Term Memory, Attention, Reaction Time, Performance, Cognitive Ability, Undergraduate Students
Geographic Terms: North Carolina (Greensboro)
ISSN: 2079-3200
Abstract: The worst performance rule (WPR) is a robust empirical finding reflecting that people's worst task performance shows numerically stronger correlations with cognitive ability than their average or best performance. However, recent meta-analytic work has proposed this be renamed the "not-best performance" rule because mean and worst performance seem to predict cognitive ability to similar degrees, with both predicting ability better than best performance. We re-analyzed data from a previously published latent-variable study to test for worst vs. not-best performance across a variety of reaction time tasks in relation to two cognitive ability constructs: working memory capacity (WMC) and propensity for task-unrelated thought (TUT). Using two methods of assessing worst performance--ranked-binning and ex-Gaussian-modeling approaches--we found evidence for both the worst and not-best performance rules. WMC followed the not-best performance rule (correlating equivalently with mean and longest response times (RTs)) but TUT propensity followed the worst performance rule (correlating more strongly with longest RTs). Additionally, we created a mini-multiverse following different outlier exclusion rules to test the robustness of our findings; our findings remained stable across the different multiverse iterations. We provisionally conclude that the worst performance rule may only arise in relation to cognitive abilities closely linked to (failures of) sustained attention.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1322589
Database: ERIC
Description
Abstract:The worst performance rule (WPR) is a robust empirical finding reflecting that people's worst task performance shows numerically stronger correlations with cognitive ability than their average or best performance. However, recent meta-analytic work has proposed this be renamed the "not-best performance" rule because mean and worst performance seem to predict cognitive ability to similar degrees, with both predicting ability better than best performance. We re-analyzed data from a previously published latent-variable study to test for worst vs. not-best performance across a variety of reaction time tasks in relation to two cognitive ability constructs: working memory capacity (WMC) and propensity for task-unrelated thought (TUT). Using two methods of assessing worst performance--ranked-binning and ex-Gaussian-modeling approaches--we found evidence for both the worst and not-best performance rules. WMC followed the not-best performance rule (correlating equivalently with mean and longest response times (RTs)) but TUT propensity followed the worst performance rule (correlating more strongly with longest RTs). Additionally, we created a mini-multiverse following different outlier exclusion rules to test the robustness of our findings; our findings remained stable across the different multiverse iterations. We provisionally conclude that the worst performance rule may only arise in relation to cognitive abilities closely linked to (failures of) sustained attention.
ISSN:2079-3200