Measuring the Impacts of Whole-School Reforms: Methodological Lessons from an Evaluation of Accelerated Schools. MDRC Working Papers on Research Methodology.
Saved in:
| Title: | Measuring the Impacts of Whole-School Reforms: Methodological Lessons from an Evaluation of Accelerated Schools. MDRC Working Papers on Research Methodology. |
|---|---|
| Language: | English |
| Authors: | Bloom, Howard S., Manpower Demonstration Research Corp., New York, NY. |
| Availability: | For full text: http://www.mdrc.org. |
| Peer Reviewed: | N |
| Page Count: | 52 |
| Publication Date: | 2001 |
| Sponsoring Agency: | Department of Education, Washington, DC. Planning and Evaluation Service. Pew Charitable Trusts, Philadelphia, PA. Alfred P. Sloan Foundation, New York, NY. |
| Document Type: | Reports - Descriptive Speeches/Meeting Papers |
| Descriptors: | Academic Achievement, Acceleration (Education), Cohort Analysis, Educational Change, Educational Research, Elementary Secondary Education, Measurement Techniques, Research Methodology |
| Abstract: | The goal of this paper is to introduce education researchers to a new approach for measuring the impact of whole-school reform. The approach is based on interrupted time-series analysis, which has been used to evaluate programs in many fields, but has not been used widely to study education initiatives. The application presented measures program impacts on student performance by comparing standardized test scores for a number of annual student cohorts in a specific grade after a reform is launched (its followup period) with the scores of cohorts from several years before the reform was launched (its baseline period). The approach is used to measure impacts on three facets of student performance: (1) average (mean) test scores, which summarizes impacts on total performance; (2) the distribution of scores across specific ranges, which helps identify where in the distribution of student performance impacts were experiences; and (3) the variation (standard deviation) of scores, which indicates how the disparity in student performance was affected. To help researchers use the approach, the paper lays out its conceptual rationale, describes its statistical procedures, explains how to interpret its findings, indicates its strengths and limitations, and illustrates how it was used to evaluate a major whole-school reform modelAccelerated Schools. (Contains 4 tables, 3 figures, and 24 references.) (Author/SLD) |
| Entry Date: | 2004 |
| Accession Number: | ED480212 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED480212 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED480212 AccessLevel: 3 PubType: Report PubTypeId: report PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Measuring the Impacts of Whole-School Reforms: Methodological Lessons from an Evaluation of Accelerated Schools. MDRC Working Papers on Research Methodology. – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Bloom%2C+Howard+S%2E%22">Bloom, Howard S.</searchLink><br /><searchLink fieldCode="AR" term="%22Manpower+Demonstration+Research+Corp%2E%2C+New+York%2C+NY%2E%22">Manpower Demonstration Research Corp., New York, NY.</searchLink> – Name: Avail Label: Availability Group: Avail Data: For full text: http://www.mdrc.org. – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: N – Name: Pages Label: Page Count Group: Src Data: 52 – Name: DatePubCY Label: Publication Date Group: Date Data: 2001 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: Department of Education, Washington, DC. Planning and Evaluation Service.<br />Pew Charitable Trusts, Philadelphia, PA.<br />Alfred P. Sloan Foundation, New York, NY. – Name: TypeDocument Label: Document Type Group: TypDoc Data: Reports - Descriptive<br />Speeches/Meeting Papers – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Acceleration+%28Education%29%22">Acceleration (Education)</searchLink><br /><searchLink fieldCode="DE" term="%22Cohort+Analysis%22">Cohort Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Change%22">Educational Change</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement+Techniques%22">Measurement Techniques</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The goal of this paper is to introduce education researchers to a new approach for measuring the impact of whole-school reform. The approach is based on interrupted time-series analysis, which has been used to evaluate programs in many fields, but has not been used widely to study education initiatives. The application presented measures program impacts on student performance by comparing standardized test scores for a number of annual student cohorts in a specific grade after a reform is launched (its followup period) with the scores of cohorts from several years before the reform was launched (its baseline period). The approach is used to measure impacts on three facets of student performance: (1) average (mean) test scores, which summarizes impacts on total performance; (2) the distribution of scores across specific ranges, which helps identify where in the distribution of student performance impacts were experiences; and (3) the variation (standard deviation) of scores, which indicates how the disparity in student performance was affected. To help researchers use the approach, the paper lays out its conceptual rationale, describes its statistical procedures, explains how to interpret its findings, indicates its strengths and limitations, and illustrates how it was used to evaluate a major whole-school reform modelAccelerated Schools. (Contains 4 tables, 3 figures, and 24 references.) (Author/SLD) – Name: DateEntry Label: Entry Date Group: Date Data: 2004 – Name: AN Label: Accession Number Group: ID Data: ED480212 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED480212 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 52 Subjects: – SubjectFull: Academic Achievement Type: general – SubjectFull: Acceleration (Education) Type: general – SubjectFull: Cohort Analysis Type: general – SubjectFull: Educational Change Type: general – SubjectFull: Educational Research Type: general – SubjectFull: Elementary Secondary Education Type: general – SubjectFull: Measurement Techniques Type: general – SubjectFull: Research Methodology Type: general Titles: – TitleFull: Measuring the Impacts of Whole-School Reforms: Methodological Lessons from an Evaluation of Accelerated Schools. MDRC Working Papers on Research Methodology. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Manpower Demonstration Research Corp., New York, NY. – PersonEntity: Name: NameFull: Bloom, Howard S. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 10 Type: published Y: 2001 |
| ResultId | 1 |
