Efficacy of Zearn Math over Two Years in Grades 3 to 5: An Experiment in Texas. EdWorkingPaper No. 25-1211
Saved in:
| Title: | Efficacy of Zearn Math over Two Years in Grades 3 to 5: An Experiment in Texas. EdWorkingPaper No. 25-1211 |
|---|---|
| Language: | English |
| Authors: | John F. Pane, Christopher Joseph Doss, Ivy Todd, Dorothy Seaman, Annenberg Institute for School Reform at Brown University, RAND Corporation, Zearn |
| Source: | Annenberg Institute for School Reform at Brown University. 2025. |
| Availability: | Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/ |
| Peer Reviewed: | N |
| Page Count: | 47 |
| Publication Date: | 2025 |
| Sponsoring Agency: | Institute of Education Sciences (ED) |
| Contract Number: | R305A230170 |
| Document Type: | Reports - Research |
| Education Level: | Early Childhood Education Elementary Education Grade 3 Primary Education Grade 4 Intermediate Grades Grade 5 Middle Schools |
| Descriptors: | Mathematics Education, Grade 3, Grade 4, Grade 5, Program Effectiveness, Computer Software, Technology Uses in Education, Urban Schools, At Risk Students, Mathematics Achievement, Teaching Methods, Elementary School Students, Student Diversity, Low Income Students, Racial Differences, Ethnicity, Gender Differences, English Learners, Achievement Tests |
| Geographic Terms: | Texas |
| Assessment and Survey Identifiers: | State of Texas Assessments of Academic Readiness (STAAR), Measures of Academic Progress |
| Abstract: | Zearn Math is a popular software platform for K-8 mathematics learning, designed to enable all students to successfully access grade-level content. RAND researchers collaborated with Zearn, the product's developer, to design this evaluation. Then RAND conducted the study independently, randomly assigning 64 schools in an urban Texas district to either supplement classroom instruction with Zearn Math in grades 3-5 for two years -- or to continue with business-as-usual, which included various other supplemental technology products. High proportions of economically disadvantaged, Hispanic, English-learner, and below-proficient students made up the primary sample of 10,000+ students. The study preregistered two confirmatory research questions about Zearn Math's effects on Texas STAAR math assessment scores, for all students and students below proficient at baseline. Those results were positive but not statistically significant; equivalent to raising a control group student from the median to the 53rd or 54th percentile. Although this study did not yield confirmatory evidence that Zearn Math improves student learning, consistent positive signals across all estimated confirmatory and exploratory effects, including on the MAP adaptive mathematics assessment, suggest it holds promise to do so. |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2025 |
| Accession Number: | ED674124 |
| Database: | ERIC |
| Abstract: | Zearn Math is a popular software platform for K-8 mathematics learning, designed to enable all students to successfully access grade-level content. RAND researchers collaborated with Zearn, the product's developer, to design this evaluation. Then RAND conducted the study independently, randomly assigning 64 schools in an urban Texas district to either supplement classroom instruction with Zearn Math in grades 3-5 for two years -- or to continue with business-as-usual, which included various other supplemental technology products. High proportions of economically disadvantaged, Hispanic, English-learner, and below-proficient students made up the primary sample of 10,000+ students. The study preregistered two confirmatory research questions about Zearn Math's effects on Texas STAAR math assessment scores, for all students and students below proficient at baseline. Those results were positive but not statistically significant; equivalent to raising a control group student from the median to the 53rd or 54th percentile. Although this study did not yield confirmatory evidence that Zearn Math improves student learning, consistent positive signals across all estimated confirmatory and exploratory effects, including on the MAP adaptive mathematics assessment, suggest it holds promise to do so. |
|---|
