Learning Analytics Application to Examine Validity and Generalizability of Game-Based Assessment for Spatial Reasoning

Saved in:
Bibliographic Details
Title: Learning Analytics Application to Examine Validity and Generalizability of Game-Based Assessment for Spatial Reasoning
Language: English
Authors: Kim, Yoon Jeon (ORCID 0000-0002-3467-1238), Knowles, Mariah A. (ORCID 0000-0002-1798-4830), Scianna, Jennifer (ORCID 0000-0003-1029-3452), Lin, Grace (ORCID 0000-0001-7552-2880), Ruipérez-Valiente, José A. (ORCID 0000-0002-2304-6365)
Source: British Journal of Educational Technology. Jan 2023 54(1):355-372.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 18
Publication Date: 2023
Sponsoring Agency: National Science Foundation (NSF)
Contract Number: 1935450
Document Type: Journal Articles
Reports - Research
Education Level: Junior High Schools
Middle Schools
Secondary Education
Descriptors: Learning Analytics, Validity, Generalizability Theory, Game Based Learning, Spatial Ability, Alternative Assessment, Psychometrics, Thinking Skills, Middle School Students, Gender Differences, Learner Engagement, Competence, Educational Games
DOI: 10.1111/bjet.13286
ISSN: 0007-1013
1467-8535
Abstract: Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.
Abstractor: As Provided
Notes: https://github.com/EducationalSciences693/ShadowspectRandomForest
Entry Date: 2023
Accession Number: EJ1364062
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.
ISSN:0007-1013
1467-8535
DOI:10.1111/bjet.13286