Validity Evidence for Forced-Choice and Mixed-Format Knowledge Assessments

Saved in:
Bibliographic Details
Title: Validity Evidence for Forced-Choice and Mixed-Format Knowledge Assessments
Language: English
Authors: Cari F. Herrmann Abell (ORCID 0000-0002-6334-7154)
Source: Grantee Submission. 2021.
Peer Reviewed: Y
Page Count: 9
Publication Date: 2021
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305A180512
R305A120138
Document Type: Speeches/Meeting Papers
Reports - Evaluative
Descriptors: Test Format, Measurement Techniques, Student Evaluation, Rating Scales, Performance Based Assessment, Observation, Best Practices, Educational Assessment, Test Validity, Evidence Based Practice
Abstract: In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking into account specific concerns for each instrument type. The purpose of the working group roundtable was to (1) illustrate validation activities and evidence for 4 distinct types of measures (forced-choice and mixed format knowledge assessments, Likert/Rating Scale instruments, performance assessments, and observation protocols), (2) facilitate a discussion of best practices for each of the measurement contexts, and (3) foster possible collaborations for dissemination of best practices for these contexts. This paper focuses on validation activities for forced-choice and mixed format knowledge assessments.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2024
Accession Number: ED661860
Database: ERIC
Description
Abstract:In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking into account specific concerns for each instrument type. The purpose of the working group roundtable was to (1) illustrate validation activities and evidence for 4 distinct types of measures (forced-choice and mixed format knowledge assessments, Likert/Rating Scale instruments, performance assessments, and observation protocols), (2) facilitate a discussion of best practices for each of the measurement contexts, and (3) foster possible collaborations for dissemination of best practices for these contexts. This paper focuses on validation activities for forced-choice and mixed format knowledge assessments.