Analysis of skew, examination of intercorrelations, and determining the optimal threshold for performance invalidity when 10 performance validity tests are administered during a neuropsychological evaluation.
Saved in:
| Title: | Analysis of skew, examination of intercorrelations, and determining the optimal threshold for performance invalidity when 10 performance validity tests are administered during a neuropsychological evaluation. |
|---|---|
| Authors: | Leese, Mira I. (AUTHOR), Finley, John-Christopher A. (AUTHOR), Basurto, Karen S. (AUTHOR), VanLandingham, Hannah B. (AUTHOR), Piszczor, Justyna (AUTHOR), Bianco, Joseph M. (AUTHOR), Phillips, Matthew S. (AUTHOR), Cerny, Brian M. (AUTHOR), Schroeder, Ryan W. (AUTHOR), Soble, Jason R. (AUTHOR) |
| Source: | Journal of Clinical & Experimental Neuropsychology. Dec2024, Vol. 46 Issue 10, p989-1000. 12p. |
| Subjects: | Neuropsychological tests, Academic medical centers, Test validity, Neuropsychology, Sensitivity & specificity (Statistics) |
| Abstract: | Introduction: This study cross-validates and expands upon previous research by examining the optimal number of PVT failures necessary to determine invalid performance when 10 PVTs are administered during a neuropsychological evaluation. Additionally, the study assessed the degree of skewness of individual PVTs and PVT intercorrelations for the overall sample and by validity group. Method: Participants were 283 adult neuropsychology outpatients evaluated at an academic medical center. Participants were initially classified as having valid (≤1 PVT failure; n = 225) or invalid (≥2 PVT failures; n = 58; base rate of 20% performance invalidity) performance based on four independent criterion PVTs. Failure rates of 10 additional PVTs were then compared, and sensitivity and specificity were calculated at different thresholds (e.g. ≥1, ≥2, ≥3, ≥4 PVT failures) to determine the optimal threshold for detecting invalid performance while maintaining ≥ 90% specificity. Results: Findings indicate that failing ≥ 2 PVTs yielded 86% sensitivity/76% specificity, failing ≥ 3 PVTs yielded 69% sensitivity/92% specificity, failing ≥ 4 PVTs yielded 57% sensitivity/96% specificity, failing ≥ 5 PVTs yielded 29% sensitivity/99% specificity, and failing ≥ 6 PVTs yielded 22% sensitivity/100% specificity. PVT intercorrelations were generally small for the overall sample and by validity group. As expected, data were more highly skewed for patients with valid performance. Conclusions: Findings were consistent with previous research and demonstrate that the three-failure threshold optimally detects invalid performance when 10 PVTs are administered. These findings inform the use of multiple PVTs in clinical settings and aid in the interpretation of PVT results. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Clinical & Experimental Neuropsychology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Introduction: This study cross-validates and expands upon previous research by examining the optimal number of PVT failures necessary to determine invalid performance when 10 PVTs are administered during a neuropsychological evaluation. Additionally, the study assessed the degree of skewness of individual PVTs and PVT intercorrelations for the overall sample and by validity group. Method: Participants were 283 adult neuropsychology outpatients evaluated at an academic medical center. Participants were initially classified as having valid (≤1 PVT failure; n = 225) or invalid (≥2 PVT failures; n = 58; base rate of 20% performance invalidity) performance based on four independent criterion PVTs. Failure rates of 10 additional PVTs were then compared, and sensitivity and specificity were calculated at different thresholds (e.g. ≥1, ≥2, ≥3, ≥4 PVT failures) to determine the optimal threshold for detecting invalid performance while maintaining ≥ 90% specificity. Results: Findings indicate that failing ≥ 2 PVTs yielded 86% sensitivity/76% specificity, failing ≥ 3 PVTs yielded 69% sensitivity/92% specificity, failing ≥ 4 PVTs yielded 57% sensitivity/96% specificity, failing ≥ 5 PVTs yielded 29% sensitivity/99% specificity, and failing ≥ 6 PVTs yielded 22% sensitivity/100% specificity. PVT intercorrelations were generally small for the overall sample and by validity group. As expected, data were more highly skewed for patients with valid performance. Conclusions: Findings were consistent with previous research and demonstrate that the three-failure threshold optimally detects invalid performance when 10 PVTs are administered. These findings inform the use of multiple PVTs in clinical settings and aid in the interpretation of PVT results. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 13803395 |
| DOI: | 10.1080/13803395.2025.2455074 |
