Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence

Saved in:
Bibliographic Details
Title: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence
Language: English
Authors: Christina Weiland, Rebecca Unterman, Susan Dynarski, Rachel Abenavoli, Howard Bloom, Breno Braga, Anne-Marie Faria, Erica Greenberg, Brian A. Jacob, Jane Arnold Lincove (ORCID 0000-0001-6656-8537), Karen Manship, Meghan McCormick, Luke Miratrix, Tomás E. Monarrez, Pamela Morris-Perez, Anna Shapiro (ORCID 0000-0001-9312-1300), Jon Valant (ORCID 0000-0001-6478-8181), Lindsay Weixler (ORCID 0000-0002-8876-0308)
Source: AERA Open. 2024 10(1).
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 23
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305H170042
Document Type: Journal Articles
Reports - Descriptive
Education Level: Early Childhood Education
Preschool Education
Descriptors: Early Childhood Education, Program Evaluation, Evaluation Methods, Admission (School), Competitive Selection, Educational Research, Research Methodology, Montessori Schools, Montessori Method, Preschool Education, Educational Quality, Research Design
Geographic Terms: Massachusetts (Boston), District of Columbia, Louisiana (New Orleans), New York (New York)
ISSN: 2332-8584
Abstract: Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next context: (a) available baseline covariates that may not be very rich; (b) limited data on the counterfactual; (c) limited and inconsistent outcome data; (d) weakened internal validity due to attrition; (e) constrained external validity due to who competes for oversubscribed programs; and (f) difficulties answering site-level questions with child-level randomization. The authors offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2025
Accession Number: EJ1455225
Database: ERIC
Description
Abstract:Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next context: (a) available baseline covariates that may not be very rich; (b) limited data on the counterfactual; (c) limited and inconsistent outcome data; (d) weakened internal validity due to attrition; (e) constrained external validity due to who competes for oversubscribed programs; and (f) difficulties answering site-level questions with child-level randomization. The authors offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.
ISSN:2332-8584