Measurement Error and Bias in Value-Added Models. Research Report. ETS RR-17-25
Saved in:
| Title: | Measurement Error and Bias in Value-Added Models. Research Report. ETS RR-17-25 |
|---|---|
| Language: | English |
| Authors: | Kane, Michael T. |
| Source: | ETS Research Report Series. Dec 2017. |
| Availability: | Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2017 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Error of Measurement, Value Added Models, Scores, Teacher Effectiveness, Bias, Computation, Achievement Gains |
| ISSN: | 2330-8516 |
| Abstract: | By aggregating residual gain scores (the differences between each student's current score and a predicted score based on prior performance) for a school or a teacher, value-added models (VAMs) can be used to generate estimates of school or teacher effects. It is known that random errors in the prior scores will introduce bias into predictions of the current scores, and thereby, into the estimated residual gain scores and VAM scores. The analyses in this paper examine the origins of this bias and its potential impact and indicate that the bias is an increasing linear function of the student's prior achievement and can be quite large (e.g., half a true-score standard deviation) for very low-scoring and high-scoring students. To the extent that students with relatively low or high prior scores are clustered in particular classes and schools, the student-level bias will tend to generate bias in VAM estimates of teacher and school effects. Adjusting for this bias is possible, but it requires estimates of generalizability (or reliability) coefficients that are more accurate and precise than those that are generally available for standardized achievement tests. |
| Abstractor: | As Provided |
| Number of References: | 42 |
| Entry Date: | 2018 |
| Accession Number: | EJ1168716 |
| Database: | ERIC |
Be the first to leave a comment!
