Towards an Online Self-Assessment for Informed Study Decisions--A Mixed-Methods Validation Study

Saved in:
Bibliographic Details
Title: Towards an Online Self-Assessment for Informed Study Decisions--A Mixed-Methods Validation Study
Language: English
Authors: Delnoij, Laurie E. C. (ORCID 0000-0001-6363-5714), Janssen, José P. W (ORCID 0000-0002-5104-7648), Dirkx, Kim J. H. (ORCID 0000-0001-8014-0916), Martens, Rob L. (ORCID 0000-0001-7193-8125)
Source: International Journal of Assessment Tools in Education. 2022 9(2):376-396.
Availability: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Peer Reviewed: Y
Page Count: 21
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
High Schools
Secondary Education
Descriptors: Computer Assisted Testing, Self Evaluation (Individuals), Decision Making, Test Validity, College Bound Students, Protocol Analysis, Knowledge Level, Student Attitudes, Foreign Countries, Student Behavior
Geographic Terms: Netherlands
ISSN: 2148-7456
Abstract: Informed study decisions are pivotal for student retention in higher online education. A self-assessment prior to enrolment has been proposed as a promising approach to enable informed decision-making and to build resources for retention. To determine whether such a self-assessment affects the decision-making process as intended, thorough and careful validation is a necessity. This study reports on two validity aspects that are less commonly addressed in that respect, but essential for evaluating effectiveness: response processes and consequences of (self-) testing. To map the response processes and consequences of the current self-assessment, a mixed-methods approach was used in which eight prospective students took a self-assessment in an observed think-aloud mode and were interviewed before and after that. Results show different response processes depending on the type of subtest that is taken. The results also indicate that consequential aspect of validity must be considered in the context of decision-making phases. The demonstrated evidence and possible threats to validity are discussed in light of refining the self-assessment and embedding it in counselling practice.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1359517
Database: ERIC
Be the first to leave a comment!
You must be logged in first