'The Wisdom of Crowds': When Teacher Judgments Outperform Word-Frequency as a Predictor of Students' Vocabulary Knowledge
Saved in:
| Title: | 'The Wisdom of Crowds': When Teacher Judgments Outperform Word-Frequency as a Predictor of Students' Vocabulary Knowledge |
|---|---|
| Language: | English |
| Authors: | Pablo Robles-García (ORCID |
| Source: | Language Teaching Research. 2026 30(4):2085-2109. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 25 |
| Publication Date: | 2026 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Higher Education, Undergraduate Students, College Faculty, Second Language Learning, Spanish, English (Second Language), Word Frequency, Vocabulary, Vocabulary Skills, Prediction, Accuracy, Teacher Attitudes, Word Lists |
| DOI: | 10.1177/13621688231176067 |
| ISSN: | 1362-1688 1477-0954 |
| Abstract: | This study investigated the effectiveness of word-frequency and teacher judgments in determining students' vocabulary knowledge and compared the predictive powers of both approaches when estimating vocabulary knowledge. Twenty-nine second language (L2) Spanish teachers were asked to predict how likely their students would know words from a 216-word Yes/No test that measures knowledge of the first 3,000 words in Spanish. The accuracy of their responses was compared with the results of 1,075 L2 Spanish students who completed the same test. To examine if the results could generalize to other L2 settings, 394 L2 English students completed a 70-word Yes/No test that measures knowledge of the first 14,000 words in English, and 15 L2 English language instructors attempted to predict which words would or would not be recognized. Results showed that for both language contexts, (1) the median teacher rater could assess students' vocabulary knowledge with an accuracy roughly comparable to frequency, (2) the combination of teachers' judgments displayed a stronger relationship with students' performance on the vocabulary test than frequency, since the average of three or more teachers' ratings improved upon frequency when examined with 1,000 bootstrapped samples, and (3) using teacher judgments and frequency together did not substantially improve the prediction of students' vocabulary knowledge. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1502954 |
| Database: | ERIC |
| Abstract: | This study investigated the effectiveness of word-frequency and teacher judgments in determining students' vocabulary knowledge and compared the predictive powers of both approaches when estimating vocabulary knowledge. Twenty-nine second language (L2) Spanish teachers were asked to predict how likely their students would know words from a 216-word Yes/No test that measures knowledge of the first 3,000 words in Spanish. The accuracy of their responses was compared with the results of 1,075 L2 Spanish students who completed the same test. To examine if the results could generalize to other L2 settings, 394 L2 English students completed a 70-word Yes/No test that measures knowledge of the first 14,000 words in English, and 15 L2 English language instructors attempted to predict which words would or would not be recognized. Results showed that for both language contexts, (1) the median teacher rater could assess students' vocabulary knowledge with an accuracy roughly comparable to frequency, (2) the combination of teachers' judgments displayed a stronger relationship with students' performance on the vocabulary test than frequency, since the average of three or more teachers' ratings improved upon frequency when examined with 1,000 bootstrapped samples, and (3) using teacher judgments and frequency together did not substantially improve the prediction of students' vocabulary knowledge. |
|---|---|
| ISSN: | 1362-1688 1477-0954 |
| DOI: | 10.1177/13621688231176067 |
