Symmetric Least Squares Estimates of Functional Relationships. Research Report. ETS RR-21-21
Saved in:
| Title: | Symmetric Least Squares Estimates of Functional Relationships. Research Report. ETS RR-21-21 |
|---|---|
| Language: | English |
| Authors: | Kane, Michael T. |
| Source: | ETS Research Report Series. Dec 2021. |
| Availability: | Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2021 |
| Document Type: | Journal Articles Reports - Evaluative |
| Descriptors: | Least Squares Statistics, Regression (Statistics), Prediction, Geometric Concepts, Geometry, Error of Measurement, Factor Analysis, Correlation |
| ISSN: | 2330-8516 |
| Abstract: | Ordinary least squares (OLS) regression provides optimal linear predictions of a dependent variable, y, given an independent variable, x, but OLS regressions are not symmetric or reversible. In order to get optimal linear predictions of x given y, a separate OLS regression in that direction would be needed. This report provides a least squares derivation of the geometric mean (GM) regression line, which is symmetric and reversible, as the line that minimizes a weighted sum of the mean squared errors for y, given x, and for x, given y. It is shown that the GM regression line is symmetric and predicts equally well (or poorly, depending on the absolute value of r[subscript xy]) in both directions. The errors of prediction for the GM line are, naturally, larger for the predictions of both x and y than those for the two OLS equations, each of which is specifically optimized for prediction in one direction, but for high values of |r[subscript xy]|, the difference is not large. The GM line has previously been derived as a special case of principal-components analysis and gets its name from the fact that its slope is equal to the geometric mean of the slopes of the OLS regressions of y on x and x on y. |
| Abstractor: | As Provided |
| Entry Date: | 2022 |
| Accession Number: | EJ1341093 |
| Database: | ERIC |
| Abstract: | Ordinary least squares (OLS) regression provides optimal linear predictions of a dependent variable, y, given an independent variable, x, but OLS regressions are not symmetric or reversible. In order to get optimal linear predictions of x given y, a separate OLS regression in that direction would be needed. This report provides a least squares derivation of the geometric mean (GM) regression line, which is symmetric and reversible, as the line that minimizes a weighted sum of the mean squared errors for y, given x, and for x, given y. It is shown that the GM regression line is symmetric and predicts equally well (or poorly, depending on the absolute value of r[subscript xy]) in both directions. The errors of prediction for the GM line are, naturally, larger for the predictions of both x and y than those for the two OLS equations, each of which is specifically optimized for prediction in one direction, but for high values of |r[subscript xy]|, the difference is not large. The GM line has previously been derived as a special case of principal-components analysis and gets its name from the fact that its slope is equal to the geometric mean of the slopes of the OLS regressions of y on x and x on y. |
|---|---|
| ISSN: | 2330-8516 |
