ALFA Lab Study Final Report

Saved in:
Bibliographic Details
Title: ALFA Lab Study Final Report
Language: English
Authors: Schoeneberger, Jason, Zhang, Xiaodong, Spinney, Samantha, Sun, Jing, Kennedy, Lauren, Rajesh Syal, Samira, ICF International, Johns Hopkins University
Source: Grantee Submission. 2023.
Peer Reviewed: Y
Page Count: 117
Publication Date: 2023
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305A180154
Document Type: Reports - Research
Numerical/Quantitative Data
Education Level: High Schools
Secondary Education
Grade 9
Junior High Schools
Middle Schools
Descriptors: High School Students, Grade 9, Learning Laboratories, Reading Centers, Reading Achievement, Economically Disadvantaged, Reading Comprehension, Reading Tests, Reading Motivation, Reading Habits, Outcomes of Education, Gender Differences, English Language Learners, Special Education, Hispanic American Students, Costs, Computer Assisted Testing, Adaptive Testing, Program Implementation
Geographic Terms: New York, Connecticut, California, Alabama
Abstract: The purpose of this study was to understand the impact, implementation and costs associated with a one-semester elective lab course in 9th grade, Accelerating Literacy for Adolescents (ALFA) Lab, which seeks to improve students' reading achievement, particularly for those from economically disadvantaged communities. This study used three cohorts of 9th grade students from four high schools in New York, Connecticut, California, and Alabama during the 2019-2022 school years to assess their reading achievement employing a regression discontinuity (RD) design. Students were identified for enrollment in the ALFA Lab course if their pre-ALFA Lab reading scores were below a cutoff. Reading achievement was measured using the comprehensive online literacy assessment STAR Reading, while reading motivation was defined using the Adaptive Reading Motivation Measure (ARMM) to obtain overall General Reading Motivation (GRM) and Reading Frequency (FRQ) scores. The four participating schools made considerable progress implementing the ALFA Lab program, as all observed ALFA Lab classes demonstrated evidence of implementing most ALFA Lab components included in the Checklist for ALFA Implementation (CFAI). Using a pooled analytic approach across cohorts and sites, ALFA students outperformed the BAU group in reading achievement (STAR assessment), reading motivation, and reading frequency (ARMM), though none of these were statistically significant. Mediation analyses revealed reading motivation and reading frequency explained 30% and 22%, respectively of estimated ALFA Lab impacts, though these effects were also non-significant. Moderation analyses found no statistically significant effects for STAR or reading motivation outcomes, but did find significant, positive effects for males, non-English Language Learner (ELL) students, non-special education (SPED) students, and Hispanic students. Average overall costs for the ALFA Lab program, as well as costs per student, are provided. Additional information presented includes an assessment of What Works Clearinghouse 5.0 Evidence for RD designs, mediation and moderation analytic approaches, implementation measurement details and participating school profiles.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2023
Accession Number: ED630221
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: ED630221
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: ALFA Lab Study Final Report
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Schoeneberger%2C+Jason%22">Schoeneberger, Jason</searchLink><br /><searchLink fieldCode="AR" term="%22Zhang%2C+Xiaodong%22">Zhang, Xiaodong</searchLink><br /><searchLink fieldCode="AR" term="%22Spinney%2C+Samantha%22">Spinney, Samantha</searchLink><br /><searchLink fieldCode="AR" term="%22Sun%2C+Jing%22">Sun, Jing</searchLink><br /><searchLink fieldCode="AR" term="%22Kennedy%2C+Lauren%22">Kennedy, Lauren</searchLink><br /><searchLink fieldCode="AR" term="%22Rajesh+Syal%2C+Samira%22">Rajesh Syal, Samira</searchLink><br /><searchLink fieldCode="AR" term="%22ICF+International%22">ICF International</searchLink><br /><searchLink fieldCode="AR" term="%22Johns+Hopkins+University%22">Johns Hopkins University</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2023.
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 117
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305A180154
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research<br />Numerical/Quantitative Data
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+9%22">Grade 9</searchLink><br /><searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+9%22">Grade 9</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Laboratories%22">Learning Laboratories</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Centers%22">Reading Centers</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Achievement%22">Reading Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Economically+Disadvantaged%22">Economically Disadvantaged</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Tests%22">Reading Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Motivation%22">Reading Motivation</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Habits%22">Reading Habits</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Gender+Differences%22">Gender Differences</searchLink><br /><searchLink fieldCode="DE" term="%22English+Language+Learners%22">English Language Learners</searchLink><br /><searchLink fieldCode="DE" term="%22Special+Education%22">Special Education</searchLink><br /><searchLink fieldCode="DE" term="%22Hispanic+American+Students%22">Hispanic American Students</searchLink><br /><searchLink fieldCode="DE" term="%22Costs%22">Costs</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Adaptive+Testing%22">Adaptive Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Implementation%22">Program Implementation</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22New+York%22">New York</searchLink><br /><searchLink fieldCode="DE" term="%22Connecticut%22">Connecticut</searchLink><br /><searchLink fieldCode="DE" term="%22California%22">California</searchLink><br /><searchLink fieldCode="DE" term="%22Alabama%22">Alabama</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The purpose of this study was to understand the impact, implementation and costs associated with a one-semester elective lab course in 9th grade, Accelerating Literacy for Adolescents (ALFA) Lab, which seeks to improve students' reading achievement, particularly for those from economically disadvantaged communities. This study used three cohorts of 9th grade students from four high schools in New York, Connecticut, California, and Alabama during the 2019-2022 school years to assess their reading achievement employing a regression discontinuity (RD) design. Students were identified for enrollment in the ALFA Lab course if their pre-ALFA Lab reading scores were below a cutoff. Reading achievement was measured using the comprehensive online literacy assessment STAR Reading, while reading motivation was defined using the Adaptive Reading Motivation Measure (ARMM) to obtain overall General Reading Motivation (GRM) and Reading Frequency (FRQ) scores. The four participating schools made considerable progress implementing the ALFA Lab program, as all observed ALFA Lab classes demonstrated evidence of implementing most ALFA Lab components included in the Checklist for ALFA Implementation (CFAI). Using a pooled analytic approach across cohorts and sites, ALFA students outperformed the BAU group in reading achievement (STAR assessment), reading motivation, and reading frequency (ARMM), though none of these were statistically significant. Mediation analyses revealed reading motivation and reading frequency explained 30% and 22%, respectively of estimated ALFA Lab impacts, though these effects were also non-significant. Moderation analyses found no statistically significant effects for STAR or reading motivation outcomes, but did find significant, positive effects for males, non-English Language Learner (ELL) students, non-special education (SPED) students, and Hispanic students. Average overall costs for the ALFA Lab program, as well as costs per student, are provided. Additional information presented includes an assessment of What Works Clearinghouse 5.0 Evidence for RD designs, mediation and moderation analytic approaches, implementation measurement details and participating school profiles.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED630221
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED630221
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 117
    Subjects:
      – SubjectFull: High School Students
        Type: general
      – SubjectFull: Grade 9
        Type: general
      – SubjectFull: Learning Laboratories
        Type: general
      – SubjectFull: Reading Centers
        Type: general
      – SubjectFull: Reading Achievement
        Type: general
      – SubjectFull: Economically Disadvantaged
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Reading Tests
        Type: general
      – SubjectFull: Reading Motivation
        Type: general
      – SubjectFull: Reading Habits
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Gender Differences
        Type: general
      – SubjectFull: English Language Learners
        Type: general
      – SubjectFull: Special Education
        Type: general
      – SubjectFull: Hispanic American Students
        Type: general
      – SubjectFull: Costs
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Adaptive Testing
        Type: general
      – SubjectFull: Program Implementation
        Type: general
      – SubjectFull: New York
        Type: general
      – SubjectFull: Connecticut
        Type: general
      – SubjectFull: California
        Type: general
      – SubjectFull: Alabama
        Type: general
    Titles:
      – TitleFull: ALFA Lab Study Final Report
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: ICF International
      – PersonEntity:
          Name:
            NameFull: Johns Hopkins University
      – PersonEntity:
          Name:
            NameFull: Schoeneberger, Jason
      – PersonEntity:
          Name:
            NameFull: Zhang, Xiaodong
      – PersonEntity:
          Name:
            NameFull: Spinney, Samantha
      – PersonEntity:
          Name:
            NameFull: Sun, Jing
      – PersonEntity:
          Name:
            NameFull: Kennedy, Lauren
      – PersonEntity:
          Name:
            NameFull: Rajesh Syal, Samira
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2023
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1