The Effect of Device Type on Achievement: Evidence from a Quasi-Experimental Design
Saved in:
| Title: | The Effect of Device Type on Achievement: Evidence from a Quasi-Experimental Design |
|---|---|
| Language: | English |
| Authors: | Rutkowski, David, Rutkowski, Leslie, Flores, Charity |
| Source: | Educational Assessment. 2022 27(3):229-246. |
| Availability: | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Peer Reviewed: | Y |
| Page Count: | 18 |
| Publication Date: | 2022 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Early Childhood Education Elementary Education Grade 3 Primary Education Grade 8 Junior High Schools Middle Schools Secondary Education |
| Descriptors: | Computer Assisted Testing, Computers, Laptop Computers, Handheld Devices, Tablet Computers, Educational Assessment, Evaluation Research, Context Effect, Academic Achievement, Standardized Tests, Grade 3, Grade 8, Student Evaluation |
| Geographic Terms: | Indiana |
| DOI: | 10.1080/10627197.2022.2043742 |
| ISSN: | 1062-7197 1532-6977 |
| Abstract: | As more states move to universal computer-based assessments, an emergent issue concerns the effect that device type might have on student results. Although, several research studies have explored device effects, most of these studies focused on the differences between tablets and desktops/laptops. In the current study, we distinguish between different types of devices to better examine the differences. Specifically, we used Indiana state assessment results from grades 3 and 8 and a propensity score weighting method to see if a student took the assessment on another device, would they have received the same score? Our findings suggest that there are significant differences by device type in both grades. In particular, iPad and Chromebook devices produced higher achievement when compared to Mac and PC devices. At the extreme, these differences amounted to close to a third of a standard deviation on the achievement scale. |
| Abstractor: | As Provided |
| Entry Date: | 2023 |
| Accession Number: | EJ1366513 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | As more states move to universal computer-based assessments, an emergent issue concerns the effect that device type might have on student results. Although, several research studies have explored device effects, most of these studies focused on the differences between tablets and desktops/laptops. In the current study, we distinguish between different types of devices to better examine the differences. Specifically, we used Indiana state assessment results from grades 3 and 8 and a propensity score weighting method to see if a student took the assessment on another device, would they have received the same score? Our findings suggest that there are significant differences by device type in both grades. In particular, iPad and Chromebook devices produced higher achievement when compared to Mac and PC devices. At the extreme, these differences amounted to close to a third of a standard deviation on the achievement scale. |
|---|---|
| ISSN: | 1062-7197 1532-6977 |
| DOI: | 10.1080/10627197.2022.2043742 |
