Explore the effectiveness of a multi-level assessment protocol for online learning.

Saved in:
Bibliographic Details
Title: Explore the effectiveness of a multi-level assessment protocol for online learning.
Authors: Mo, Ya1 yzm0043@auburn.edu, Jung, Eulho2, Yoon, Meehyun3
Source: Contemporary Educational Technology. Oct2025, Vol. 17 Issue 4, p1-26. 26p.
Subject Terms: *Online education, *Self-evaluation, *Activity programs in education, *Educational outcomes, *Graduate students, Introspection, Thematic analysis
Abstract: This study examines the effectiveness of a multi-level assessment protocol for online learning, particularly the use of reflection and self-assessment as learning and assessment tools, by capturing and interpreting five graduate students' experiences in an online assessment course. Data were collected through surveys, reflection questions, self-assessments, pre-assessments, and module assessments. Likert-scale survey questions and selected-response reflection questions or assessment items were analyzed by counting responses or tallying correct answers. Open-ended survey questions, reflection questions, and assessment items were analyzed qualitatively using thematic analysis. Results reveal that combining traditional tests with reflection enhances assessments as learning tools, emphasizing the necessity of carefully formulated reflection questions. For self-assessment with constructed-response tests, providing students with illustrative responses and detailed rubrics that clearly state the number and scope of key points expected in responses can help standardize students' subjective judgments. Furthermore, the unanimous preference for hands-on projects among students and the frustration expressed by some regarding asynchronous discussions underscore the importance of offering diverse, flexible, and engaging activities across various modalities to support learning outcomes. Overall, the findings affirm the enhancement of assessments as learning tools through the amalgamation of traditional tests with reflection and self-assessment, while also pinpointing the need for thoughtful implementation. [ABSTRACT FROM AUTHOR]
Copyright of Contemporary Educational Technology is the property of Bastas Publications and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Description
Abstract:This study examines the effectiveness of a multi-level assessment protocol for online learning, particularly the use of reflection and self-assessment as learning and assessment tools, by capturing and interpreting five graduate students' experiences in an online assessment course. Data were collected through surveys, reflection questions, self-assessments, pre-assessments, and module assessments. Likert-scale survey questions and selected-response reflection questions or assessment items were analyzed by counting responses or tallying correct answers. Open-ended survey questions, reflection questions, and assessment items were analyzed qualitatively using thematic analysis. Results reveal that combining traditional tests with reflection enhances assessments as learning tools, emphasizing the necessity of carefully formulated reflection questions. For self-assessment with constructed-response tests, providing students with illustrative responses and detailed rubrics that clearly state the number and scope of key points expected in responses can help standardize students' subjective judgments. Furthermore, the unanimous preference for hands-on projects among students and the frustration expressed by some regarding asynchronous discussions underscore the importance of offering diverse, flexible, and engaging activities across various modalities to support learning outcomes. Overall, the findings affirm the enhancement of assessments as learning tools through the amalgamation of traditional tests with reflection and self-assessment, while also pinpointing the need for thoughtful implementation. [ABSTRACT FROM AUTHOR]
ISSN:1309517X
DOI:10.30935/cedtech/17547