Using Topic Models to Understand Rater-Mediated Writing Assessments
Saved in:
| Title: | Using Topic Models to Understand Rater-Mediated Writing Assessments |
|---|---|
| Language: | English |
| Authors: | Jordan M. Wheeler (ORCID |
| Source: | Journal of Experimental Education. 2024 92(1):186-205. |
| Availability: | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Peer Reviewed: | Y |
| Page Count: | 20 |
| Publication Date: | 2024 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Junior High Schools Middle Schools Secondary Education Elementary Education Grade 6 Intermediate Grades Grade 8 |
| Descriptors: | Middle School Students, Grade 6, Grade 8, Mathematical Models, Word Processing, Cognitive Mapping, Writing Strategies, Performance Technology |
| DOI: | 10.1080/00220973.2022.2130129 |
| ISSN: | 0022-0973 1940-0683 |
| Abstract: | Integrated writing assessments are tasks that require students to construct an essay using evidence from source texts. Topic models are statistical models used to analyze text. This study analyzes two integrated writing tasks from students in grades 6 (N=1,250) and 8 (N=1,250) using topic models. Independent evaluations of the essays were also conducted to help generalize the results across the two grades and better understand students' underlying writing techniques. Four main categories were identified: (1) use of words that appeared in the prompt, (2) words that appeared in the source texts, (3) words that reflected inference, and (4) words that reflected integration. Higher-scoring students used words that reflect inference and integration of source text more often than lower-performing students. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| Accession Number: | EJ1404995 |
| Database: | ERIC |
| Abstract: | Integrated writing assessments are tasks that require students to construct an essay using evidence from source texts. Topic models are statistical models used to analyze text. This study analyzes two integrated writing tasks from students in grades 6 (N=1,250) and 8 (N=1,250) using topic models. Independent evaluations of the essays were also conducted to help generalize the results across the two grades and better understand students' underlying writing techniques. Four main categories were identified: (1) use of words that appeared in the prompt, (2) words that appeared in the source texts, (3) words that reflected inference, and (4) words that reflected integration. Higher-scoring students used words that reflect inference and integration of source text more often than lower-performing students. |
|---|---|
| ISSN: | 0022-0973 1940-0683 |
| DOI: | 10.1080/00220973.2022.2130129 |
