View in EDS

Towards an Online Self-Assessment for Informed Study Decisions--A Mixed-Methods Validation Study

Saved in:
Bibliographic Details
Title: Towards an Online Self-Assessment for Informed Study Decisions--A Mixed-Methods Validation Study
Language: English
Authors: Delnoij, Laurie E. C. (ORCID 0000-0001-6363-5714), Janssen, José P. W (ORCID 0000-0002-5104-7648), Dirkx, Kim J. H. (ORCID 0000-0001-8014-0916), Martens, Rob L. (ORCID 0000-0001-7193-8125)
Source: International Journal of Assessment Tools in Education. 2022 9(2):376-396.
Availability: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Peer Reviewed: Y
Page Count: 21
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
High Schools
Secondary Education
Descriptors: Computer Assisted Testing, Self Evaluation (Individuals), Decision Making, Test Validity, College Bound Students, Protocol Analysis, Knowledge Level, Student Attitudes, Foreign Countries, Student Behavior
Geographic Terms: Netherlands
ISSN: 2148-7456
Abstract: Informed study decisions are pivotal for student retention in higher online education. A self-assessment prior to enrolment has been proposed as a promising approach to enable informed decision-making and to build resources for retention. To determine whether such a self-assessment affects the decision-making process as intended, thorough and careful validation is a necessity. This study reports on two validity aspects that are less commonly addressed in that respect, but essential for evaluating effectiveness: response processes and consequences of (self-) testing. To map the response processes and consequences of the current self-assessment, a mixed-methods approach was used in which eight prospective students took a self-assessment in an observed think-aloud mode and were interviewed before and after that. Results show different response processes depending on the type of subtest that is taken. The results also indicate that consequential aspect of validity must be considered in the context of decision-making phases. The demonstrated evidence and possible threats to validity are discussed in light of refining the self-assessment and embedding it in counselling practice.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1359517
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1359517
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1359517
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Towards an Online Self-Assessment for Informed Study Decisions--A Mixed-Methods Validation Study
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Delnoij%2C+Laurie+E%2E+C%2E%22">Delnoij, Laurie E. C.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6363-5714">0000-0001-6363-5714</externalLink>)<br /><searchLink fieldCode="AR" term="%22Janssen%2C+José+P%2E+W%22">Janssen, José P. W</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-5104-7648">0000-0002-5104-7648</externalLink>)<br /><searchLink fieldCode="AR" term="%22Dirkx%2C+Kim+J%2E+H%2E%22">Dirkx, Kim J. H.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-8014-0916">0000-0001-8014-0916</externalLink>)<br /><searchLink fieldCode="AR" term="%22Martens%2C+Rob+L%2E%22">Martens, Rob L.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7193-8125">0000-0001-7193-8125</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Assessment+Tools+in+Education%22"><i>International Journal of Assessment Tools in Education</i></searchLink>. 2022 9(2):376-396.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 21
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Self+Evaluation+%28Individuals%29%22">Self Evaluation (Individuals)</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+Making%22">Decision Making</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22College+Bound+Students%22">College Bound Students</searchLink><br /><searchLink fieldCode="DE" term="%22Protocol+Analysis%22">Protocol Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Knowledge+Level%22">Knowledge Level</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Netherlands%22">Netherlands</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2148-7456
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Informed study decisions are pivotal for student retention in higher online education. A self-assessment prior to enrolment has been proposed as a promising approach to enable informed decision-making and to build resources for retention. To determine whether such a self-assessment affects the decision-making process as intended, thorough and careful validation is a necessity. This study reports on two validity aspects that are less commonly addressed in that respect, but essential for evaluating effectiveness: response processes and consequences of (self-) testing. To map the response processes and consequences of the current self-assessment, a mixed-methods approach was used in which eight prospective students took a self-assessment in an observed think-aloud mode and were interviewed before and after that. Results show different response processes depending on the type of subtest that is taken. The results also indicate that consequential aspect of validity must be considered in the context of decision-making phases. The demonstrated evidence and possible threats to validity are discussed in light of refining the self-assessment and embedding it in counselling practice.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1359517
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1359517
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
        StartPage: 376
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Self Evaluation (Individuals)
        Type: general
      – SubjectFull: Decision Making
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: College Bound Students
        Type: general
      – SubjectFull: Protocol Analysis
        Type: general
      – SubjectFull: Knowledge Level
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Student Behavior
        Type: general
      – SubjectFull: Netherlands
        Type: general
    Titles:
      – TitleFull: Towards an Online Self-Assessment for Informed Study Decisions--A Mixed-Methods Validation Study
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Delnoij, Laurie E. C.
      – PersonEntity:
          Name:
            NameFull: Janssen, José P. W
      – PersonEntity:
          Name:
            NameFull: Dirkx, Kim J. H.
      – PersonEntity:
          Name:
            NameFull: Martens, Rob L.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-electronic
              Value: 2148-7456
          Numbering:
            – Type: volume
              Value: 9
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: International Journal of Assessment Tools in Education
              Type: main
ResultId 1