Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence. EdWorkingPaper No. 23-726
Saved in:
| Title: | Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence. EdWorkingPaper No. 23-726 |
|---|---|
| Language: | English |
| Authors: | Christina Weiland, Rebecca Unterman, Susan Dynarski, Rachel Abenavoli, Howard Bloom, Breno Braga, Anne-Marie Faria, Erica Greenberg, Brian Jacob, Jane Arnold Lincove, Karen Manship, Meghan McCormick, Luke Miratrix, Tomás E. Monarrez, Pamela Morris-Perez, Anna Shapiro, Jon Valant, Lindsay Weixler, Annenberg Institute for School Reform at Brown University |
| Source: | Annenberg Institute for School Reform at Brown University. 2023. |
| Availability: | Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/ |
| Peer Reviewed: | N |
| Page Count: | 58 |
| Publication Date: | 2023 |
| Sponsoring Agency: | Institute of Education Sciences (ED) Arnold Ventures Heising-Simons Foundation Spencer Foundation |
| Document Type: | Reports - Descriptive |
| Education Level: | Early Childhood Education Preschool Education |
| Descriptors: | Early Childhood Education, Program Evaluation, Evaluation Methods, Admission (School), Competitive Selection, Educational Research, Research Methodology, Montessori Schools, Montessori Method, Preschool Education, Educational Quality, Research Design |
| Geographic Terms: | Massachusetts (Boston), District of Columbia, Louisiana (New Orleans), New York (New York) |
| Abstract: | Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. Our collaborative network of five research teams applying this design in early education and methods experts has identified six challenges that need to be carefully considered in this next context: (1) available baseline covariates may not be very rich; (2) limited data on the counterfactual; (3) limited and inconsistent outcome data; (4) weakened internal validity due to attrition; (5) constrained external validity due to who competes for oversubscribed programs; and (6) difficulties answering site-level questions with child-level randomization. We offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies. |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2025 |
| Accession Number: | ED672221 |
| Database: | ERIC |
| Abstract: | Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. Our collaborative network of five research teams applying this design in early education and methods experts has identified six challenges that need to be carefully considered in this next context: (1) available baseline covariates may not be very rich; (2) limited data on the counterfactual; (3) limited and inconsistent outcome data; (4) weakened internal validity due to attrition; (5) constrained external validity due to who competes for oversubscribed programs; and (6) difficulties answering site-level questions with child-level randomization. We offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies. |
|---|
