View in EDS

A Comment on Early Student Blunders on Computer-Based Adaptive Tests

Saved in:
Bibliographic Details
Title: A Comment on Early Student Blunders on Computer-Based Adaptive Tests
Language: English
Authors: Green, Bert F.
Source: Applied Psychological Measurement. Mar 2011 35(2):165-174.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Physical Description: PDF
Page Count: 10
Publication Date: 2011
Document Type: Journal Articles
Reports - Evaluative
Descriptors: Adaptive Testing, Computer Assisted Testing, Test Bias, Item Response Theory, Test Items, Scores, Data Analysis, Academic Ability, Students
DOI: 10.1177/0146621610377080
ISSN: 0146-6216
Abstract: This article refutes a recent claim that computer-based tests produce biased scores for very proficient test takers who make mistakes on one or two initial items and that the "bias" can be reduced by using a four-parameter IRT model. Because the same effect occurs with pattern scores on nonadaptive tests, the effect results from IRT scoring, not from adaptive testing. Because very proficient test takers rarely err on items of middle difficulty, the so-called bias is one of selective data analysis. Furthermore, the apparently large score penalty for one error on an otherwise perfect response pattern is shown to result from the relative stretching of the IRT scale at very high and very low proficiencies. The recommended use of a four-parameter IRT model is shown to have drawbacks. (Contains 6 figures.)
Abstractor: As Provided
Number of References: 8
Entry Date: 2011
Accession Number: EJ916025
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ916025
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Comment on Early Student Blunders on Computer-Based Adaptive Tests
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Green%2C+Bert+F%2E%22">Green, Bert F.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Applied+Psychological+Measurement%22"><i>Applied Psychological Measurement</i></searchLink>. Mar 2011 35(2):165-174.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: PhysDesc
  Label: Physical Description
  Group: PhysDesc
  Data: PDF
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 10
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2011
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Adaptive+Testing%22">Adaptive Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Bias%22">Test Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Analysis%22">Data Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Ability%22">Academic Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Students%22">Students</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/0146621610377080
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0146-6216
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This article refutes a recent claim that computer-based tests produce biased scores for very proficient test takers who make mistakes on one or two initial items and that the "bias" can be reduced by using a four-parameter IRT model. Because the same effect occurs with pattern scores on nonadaptive tests, the effect results from IRT scoring, not from adaptive testing. Because very proficient test takers rarely err on items of middle difficulty, the so-called bias is one of selective data analysis. Furthermore, the apparently large score penalty for one error on an otherwise perfect response pattern is shown to result from the relative stretching of the IRT scale at very high and very low proficiencies. The recommended use of a four-parameter IRT model is shown to have drawbacks. (Contains 6 figures.)
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 8
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2011
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ916025
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ916025
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/0146621610377080
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 10
        StartPage: 165
    Subjects:
      – SubjectFull: Adaptive Testing
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Test Bias
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Data Analysis
        Type: general
      – SubjectFull: Academic Ability
        Type: general
      – SubjectFull: Students
        Type: general
    Titles:
      – TitleFull: A Comment on Early Student Blunders on Computer-Based Adaptive Tests
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Green, Bert F.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Type: published
              Y: 2011
          Identifiers:
            – Type: issn-print
              Value: 0146-6216
          Numbering:
            – Type: volume
              Value: 35
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Applied Psychological Measurement
              Type: main
ResultId 1