One Score to Rule Them All? Comparing the Predictive and Concurrent Validity of 30 Hearts and Flowers Scoring Approaches
Saved in:
| Title: | One Score to Rule Them All? Comparing the Predictive and Concurrent Validity of 30 Hearts and Flowers Scoring Approaches |
|---|---|
| Language: | English |
| Authors: | Tiffany Wu (ORCID |
| Source: | Grantee Submission. 2024. |
| Peer Reviewed: | Y |
| Page Count: | 19 |
| Publication Date: | 2024 |
| Sponsoring Agency: | Institute of Education Sciences (ED) |
| Contract Number: | R305B150012 R305N160018 |
| Document Type: | Reports - Research |
| Education Level: | Early Childhood Education Elementary Education Kindergarten Primary Education |
| Descriptors: | Scoring, Executive Function, Kindergarten, Young Children, Cognitive Tests, Predictive Validity, Test Validity, Accuracy, Reaction Time, Achievement Gains, Academic Achievement, Scores |
| Geographic Terms: | Massachusetts (Boston) |
| Assessment and Survey Identifiers: | Social Skills Improvement Rating Systems, Peabody Picture Vocabulary Test |
| DOI: | 10.1177/10731911241229566 |
| Abstract: | The Hearts and Flowers (H&F) task is a computerized executive functioning (EF) assessment that has been used to measure EF from early childhood to adulthood. It provides data on accuracy and reaction time (RT) across three different task blocks (hearts, flowers, and mixed). However, there is a lack of consensus in the field on how to score the task that makes it difficult to interpret findings across studies. The current study, which includes a demographically diverse population of kindergarteners from Boston Public Schools (N = 946), compares the predictive and concurrent validity of 30 ways of scoring H&F, each with a different combination of accuracy, RT, and task block(s). Our exploratory results provide evidence supporting the use of a "two-vector average" score based on Zelazo et al.'s approach of adding accuracy and RT scores together only after individuals pass a certain accuracy threshold. Findings have implications for scoring future tablet-based developmental assessments. [This is the online version of an article published in "Assessment."] |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2024 |
| Accession Number: | ED642069 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | The Hearts and Flowers (H&F) task is a computerized executive functioning (EF) assessment that has been used to measure EF from early childhood to adulthood. It provides data on accuracy and reaction time (RT) across three different task blocks (hearts, flowers, and mixed). However, there is a lack of consensus in the field on how to score the task that makes it difficult to interpret findings across studies. The current study, which includes a demographically diverse population of kindergarteners from Boston Public Schools (N = 946), compares the predictive and concurrent validity of 30 ways of scoring H&F, each with a different combination of accuracy, RT, and task block(s). Our exploratory results provide evidence supporting the use of a "two-vector average" score based on Zelazo et al.'s approach of adding accuracy and RT scores together only after individuals pass a certain accuracy threshold. Findings have implications for scoring future tablet-based developmental assessments. [This is the online version of an article published in "Assessment."] |
|---|---|
| DOI: | 10.1177/10731911241229566 |
