View in EDS

Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence

Saved in:
Bibliographic Details
Title: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence
Language: English
Authors: Christina Weiland, Rebecca Unterman, Susan Dynarski, Rachel Abenavoli, Howard Bloom, Breno Braga, Anne-Marie Faria, Erica Greenberg, Brian A. Jacob, Jane Arnold Lincove (ORCID 0000-0001-6656-8537), Karen Manship, Meghan McCormick, Luke Miratrix, Tomás E. Monarrez, Pamela Morris-Perez, Anna Shapiro (ORCID 0000-0001-9312-1300), Jon Valant (ORCID 0000-0001-6478-8181), Lindsay Weixler (ORCID 0000-0002-8876-0308)
Source: AERA Open. 2024 10(1).
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 23
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305H170042
Document Type: Journal Articles
Reports - Descriptive
Education Level: Early Childhood Education
Preschool Education
Descriptors: Early Childhood Education, Program Evaluation, Evaluation Methods, Admission (School), Competitive Selection, Educational Research, Research Methodology, Montessori Schools, Montessori Method, Preschool Education, Educational Quality, Research Design
Geographic Terms: Massachusetts (Boston), District of Columbia, Louisiana (New Orleans), New York (New York)
ISSN: 2332-8584
Abstract: Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next context: (a) available baseline covariates that may not be very rich; (b) limited data on the counterfactual; (c) limited and inconsistent outcome data; (d) weakened internal validity due to attrition; (e) constrained external validity due to who competes for oversubscribed programs; and (f) difficulties answering site-level questions with child-level randomization. The authors offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2025
Accession Number: EJ1455225
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1455225
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1455225
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Christina+Weiland%22">Christina Weiland</searchLink><br /><searchLink fieldCode="AR" term="%22Rebecca+Unterman%22">Rebecca Unterman</searchLink><br /><searchLink fieldCode="AR" term="%22Susan+Dynarski%22">Susan Dynarski</searchLink><br /><searchLink fieldCode="AR" term="%22Rachel+Abenavoli%22">Rachel Abenavoli</searchLink><br /><searchLink fieldCode="AR" term="%22Howard+Bloom%22">Howard Bloom</searchLink><br /><searchLink fieldCode="AR" term="%22Breno+Braga%22">Breno Braga</searchLink><br /><searchLink fieldCode="AR" term="%22Anne-Marie+Faria%22">Anne-Marie Faria</searchLink><br /><searchLink fieldCode="AR" term="%22Erica+Greenberg%22">Erica Greenberg</searchLink><br /><searchLink fieldCode="AR" term="%22Brian+A%2E+Jacob%22">Brian A. Jacob</searchLink><br /><searchLink fieldCode="AR" term="%22Jane+Arnold+Lincove%22">Jane Arnold Lincove</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6656-8537">0000-0001-6656-8537</externalLink>)<br /><searchLink fieldCode="AR" term="%22Karen+Manship%22">Karen Manship</searchLink><br /><searchLink fieldCode="AR" term="%22Meghan+McCormick%22">Meghan McCormick</searchLink><br /><searchLink fieldCode="AR" term="%22Luke+Miratrix%22">Luke Miratrix</searchLink><br /><searchLink fieldCode="AR" term="%22Tomás+E%2E+Monarrez%22">Tomás E. Monarrez</searchLink><br /><searchLink fieldCode="AR" term="%22Pamela+Morris-Perez%22">Pamela Morris-Perez</searchLink><br /><searchLink fieldCode="AR" term="%22Anna+Shapiro%22">Anna Shapiro</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-9312-1300">0000-0001-9312-1300</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jon+Valant%22">Jon Valant</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6478-8181">0000-0001-6478-8181</externalLink>)<br /><searchLink fieldCode="AR" term="%22Lindsay+Weixler%22">Lindsay Weixler</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8876-0308">0000-0002-8876-0308</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22AERA+Open%22"><i>AERA Open</i></searchLink>. 2024 10(1).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305H170042
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Descriptive
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Preschool+Education%22">Preschool Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Evaluation%22">Program Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Admission+%28School%29%22">Admission (School)</searchLink><br /><searchLink fieldCode="DE" term="%22Competitive+Selection%22">Competitive Selection</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Montessori+Schools%22">Montessori Schools</searchLink><br /><searchLink fieldCode="DE" term="%22Montessori+Method%22">Montessori Method</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Quality%22">Educational Quality</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Design%22">Research Design</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Massachusetts+%28Boston%29%22">Massachusetts (Boston)</searchLink><br /><searchLink fieldCode="DE" term="%22District+of+Columbia%22">District of Columbia</searchLink><br /><searchLink fieldCode="DE" term="%22Louisiana+%28New+Orleans%29%22">Louisiana (New Orleans)</searchLink><br /><searchLink fieldCode="DE" term="%22New+York+%28New+York%29%22">New York (New York)</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2332-8584
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next context: (a) available baseline covariates that may not be very rich; (b) limited data on the counterfactual; (c) limited and inconsistent outcome data; (d) weakened internal validity due to attrition; (e) constrained external validity due to who competes for oversubscribed programs; and (f) difficulties answering site-level questions with child-level randomization. The authors offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1455225
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1455225
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
    Subjects:
      – SubjectFull: Early Childhood Education
        Type: general
      – SubjectFull: Program Evaluation
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Admission (School)
        Type: general
      – SubjectFull: Competitive Selection
        Type: general
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Research Methodology
        Type: general
      – SubjectFull: Montessori Schools
        Type: general
      – SubjectFull: Montessori Method
        Type: general
      – SubjectFull: Preschool Education
        Type: general
      – SubjectFull: Educational Quality
        Type: general
      – SubjectFull: Research Design
        Type: general
      – SubjectFull: Massachusetts (Boston)
        Type: general
      – SubjectFull: District of Columbia
        Type: general
      – SubjectFull: Louisiana (New Orleans)
        Type: general
      – SubjectFull: New York (New York)
        Type: general
    Titles:
      – TitleFull: Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Christina Weiland
      – PersonEntity:
          Name:
            NameFull: Rebecca Unterman
      – PersonEntity:
          Name:
            NameFull: Susan Dynarski
      – PersonEntity:
          Name:
            NameFull: Rachel Abenavoli
      – PersonEntity:
          Name:
            NameFull: Howard Bloom
      – PersonEntity:
          Name:
            NameFull: Breno Braga
      – PersonEntity:
          Name:
            NameFull: Anne-Marie Faria
      – PersonEntity:
          Name:
            NameFull: Erica Greenberg
      – PersonEntity:
          Name:
            NameFull: Brian A. Jacob
      – PersonEntity:
          Name:
            NameFull: Jane Arnold Lincove
      – PersonEntity:
          Name:
            NameFull: Karen Manship
      – PersonEntity:
          Name:
            NameFull: Meghan McCormick
      – PersonEntity:
          Name:
            NameFull: Luke Miratrix
      – PersonEntity:
          Name:
            NameFull: Tomás E. Monarrez
      – PersonEntity:
          Name:
            NameFull: Pamela Morris-Perez
      – PersonEntity:
          Name:
            NameFull: Anna Shapiro
      – PersonEntity:
          Name:
            NameFull: Jon Valant
      – PersonEntity:
          Name:
            NameFull: Lindsay Weixler
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-electronic
              Value: 2332-8584
          Numbering:
            – Type: volume
              Value: 10
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: AERA Open
              Type: main
ResultId 1