Efficacy of Zearn Math over Two Years in Grades 3 to 5: An Experiment in Texas. EdWorkingPaper No. 25-1211
Saved in:
| Title: | Efficacy of Zearn Math over Two Years in Grades 3 to 5: An Experiment in Texas. EdWorkingPaper No. 25-1211 |
|---|---|
| Language: | English |
| Authors: | John F. Pane, Christopher Joseph Doss, Ivy Todd, Dorothy Seaman, Annenberg Institute for School Reform at Brown University, RAND Corporation, Zearn |
| Source: | Annenberg Institute for School Reform at Brown University. 2025. |
| Availability: | Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/ |
| Peer Reviewed: | N |
| Page Count: | 47 |
| Publication Date: | 2025 |
| Sponsoring Agency: | Institute of Education Sciences (ED) |
| Contract Number: | R305A230170 |
| Document Type: | Reports - Research |
| Education Level: | Early Childhood Education Elementary Education Grade 3 Primary Education Grade 4 Intermediate Grades Grade 5 Middle Schools |
| Descriptors: | Mathematics Education, Grade 3, Grade 4, Grade 5, Program Effectiveness, Computer Software, Technology Uses in Education, Urban Schools, At Risk Students, Mathematics Achievement, Teaching Methods, Elementary School Students, Student Diversity, Low Income Students, Racial Differences, Ethnicity, Gender Differences, English Learners, Achievement Tests |
| Geographic Terms: | Texas |
| Assessment and Survey Identifiers: | State of Texas Assessments of Academic Readiness (STAAR), Measures of Academic Progress |
| Abstract: | Zearn Math is a popular software platform for K-8 mathematics learning, designed to enable all students to successfully access grade-level content. RAND researchers collaborated with Zearn, the product's developer, to design this evaluation. Then RAND conducted the study independently, randomly assigning 64 schools in an urban Texas district to either supplement classroom instruction with Zearn Math in grades 3-5 for two years -- or to continue with business-as-usual, which included various other supplemental technology products. High proportions of economically disadvantaged, Hispanic, English-learner, and below-proficient students made up the primary sample of 10,000+ students. The study preregistered two confirmatory research questions about Zearn Math's effects on Texas STAAR math assessment scores, for all students and students below proficient at baseline. Those results were positive but not statistically significant; equivalent to raising a control group student from the median to the 53rd or 54th percentile. Although this study did not yield confirmatory evidence that Zearn Math improves student learning, consistent positive signals across all estimated confirmatory and exploratory effects, including on the MAP adaptive mathematics assessment, suggest it holds promise to do so. |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2025 |
| Accession Number: | ED674124 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED674124 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED674124 AccessLevel: 3 PubType: Report PubTypeId: report PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Efficacy of Zearn Math over Two Years in Grades 3 to 5: An Experiment in Texas. EdWorkingPaper No. 25-1211 – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22John+F%2E+Pane%22">John F. Pane</searchLink><br /><searchLink fieldCode="AR" term="%22Christopher+Joseph+Doss%22">Christopher Joseph Doss</searchLink><br /><searchLink fieldCode="AR" term="%22Ivy+Todd%22">Ivy Todd</searchLink><br /><searchLink fieldCode="AR" term="%22Dorothy+Seaman%22">Dorothy Seaman</searchLink><br /><searchLink fieldCode="AR" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22">Annenberg Institute for School Reform at Brown University</searchLink><br /><searchLink fieldCode="AR" term="%22RAND+Corporation%22">RAND Corporation</searchLink><br /><searchLink fieldCode="AR" term="%22Zearn%22">Zearn</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Annenberg+Institute+for+School+Reform+at+Brown+University%22"><i>Annenberg Institute for School Reform at Brown University</i></searchLink>. 2025. – Name: Avail Label: Availability Group: Avail Data: Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/ – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: N – Name: Pages Label: Page Count Group: Src Data: 47 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: Institute of Education Sciences (ED) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: R305A230170 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="EL" term="%22Primary+Education%22">Primary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+4%22">Grade 4</searchLink><br /><searchLink fieldCode="EL" term="%22Intermediate+Grades%22">Intermediate Grades</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+5%22">Grade 5</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Mathematics+Education%22">Mathematics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+4%22">Grade 4</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+5%22">Grade 5</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Urban+Schools%22">Urban Schools</searchLink><br /><searchLink fieldCode="DE" term="%22At+Risk+Students%22">At Risk Students</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Achievement%22">Mathematics Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Diversity%22">Student Diversity</searchLink><br /><searchLink fieldCode="DE" term="%22Low+Income+Students%22">Low Income Students</searchLink><br /><searchLink fieldCode="DE" term="%22Racial+Differences%22">Racial Differences</searchLink><br /><searchLink fieldCode="DE" term="%22Ethnicity%22">Ethnicity</searchLink><br /><searchLink fieldCode="DE" term="%22Gender+Differences%22">Gender Differences</searchLink><br /><searchLink fieldCode="DE" term="%22English+Learners%22">English Learners</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Tests%22">Achievement Tests</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Texas%22">Texas</searchLink> – Name: SubjectThesaurus Label: Assessment and Survey Identifiers Group: Su Data: <searchLink fieldCode="SU" term="%22State+of+Texas+Assessments+of+Academic+Readiness+%28STAAR%29%22">State of Texas Assessments of Academic Readiness (STAAR)</searchLink><br /><searchLink fieldCode="SU" term="%22Measures+of+Academic+Progress%22">Measures of Academic Progress</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Zearn Math is a popular software platform for K-8 mathematics learning, designed to enable all students to successfully access grade-level content. RAND researchers collaborated with Zearn, the product's developer, to design this evaluation. Then RAND conducted the study independently, randomly assigning 64 schools in an urban Texas district to either supplement classroom instruction with Zearn Math in grades 3-5 for two years -- or to continue with business-as-usual, which included various other supplemental technology products. High proportions of economically disadvantaged, Hispanic, English-learner, and below-proficient students made up the primary sample of 10,000+ students. The study preregistered two confirmatory research questions about Zearn Math's effects on Texas STAAR math assessment scores, for all students and students below proficient at baseline. Those results were positive but not statistically significant; equivalent to raising a control group student from the median to the 53rd or 54th percentile. Although this study did not yield confirmatory evidence that Zearn Math improves student learning, consistent positive signals across all estimated confirmatory and exploratory effects, including on the MAP adaptive mathematics assessment, suggest it holds promise to do so. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: CodeSource Label: IES Funded Group: SrcInfo Data: Yes – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: ED674124 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED674124 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 47 Subjects: – SubjectFull: Mathematics Education Type: general – SubjectFull: Grade 3 Type: general – SubjectFull: Grade 4 Type: general – SubjectFull: Grade 5 Type: general – SubjectFull: Program Effectiveness Type: general – SubjectFull: Computer Software Type: general – SubjectFull: Technology Uses in Education Type: general – SubjectFull: Urban Schools Type: general – SubjectFull: At Risk Students Type: general – SubjectFull: Mathematics Achievement Type: general – SubjectFull: Teaching Methods Type: general – SubjectFull: Elementary School Students Type: general – SubjectFull: Student Diversity Type: general – SubjectFull: Low Income Students Type: general – SubjectFull: Racial Differences Type: general – SubjectFull: Ethnicity Type: general – SubjectFull: Gender Differences Type: general – SubjectFull: English Learners Type: general – SubjectFull: Achievement Tests Type: general – SubjectFull: Texas Type: general – SubjectFull: State of Texas Assessments of Academic Readiness (STAAR) Type: general – SubjectFull: Measures of Academic Progress Type: general Titles: – TitleFull: Efficacy of Zearn Math over Two Years in Grades 3 to 5: An Experiment in Texas. EdWorkingPaper No. 25-1211 Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Annenberg Institute for School Reform at Brown University – PersonEntity: Name: NameFull: RAND Corporation – PersonEntity: Name: NameFull: Zearn – PersonEntity: Name: NameFull: John F. Pane – PersonEntity: Name: NameFull: Christopher Joseph Doss – PersonEntity: Name: NameFull: Ivy Todd – PersonEntity: Name: NameFull: Dorothy Seaman IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Type: published Y: 2025 Titles: – TitleFull: Annenberg Institute for School Reform at Brown University Type: main |
| ResultId | 1 |