Category Scoring Techniques from National Assessment: Applications to Free Response Items from Career and Occupational Development.

Saved in:
Bibliographic Details
Title: Category Scoring Techniques from National Assessment: Applications to Free Response Items from Career and Occupational Development.
Authors: Phillips, Donald L., Education Commission of the States, Denver, CO. National Assessment of Educational Progress.
Peer Reviewed: N
Page Count: 18
Publication Date: 2025
Document Type: Reports - Research
Descriptors: Elementary Secondary Education, Essay Tests, Guides, National Surveys, Occupational Tests, Reliability, Scoring, Young Adults
Assessment and Survey Identifiers: National Assessment of Educational Progress
Abstract: The Career and Occupational Development (COD) assessment of the National Assessment of Educational Progress (NAEP) was made up of about 70 percent free response exercises requiring hand scoring. This paper describes the techniques used in developing the "scoring guides" for these exercises and summarizes the results of two empirical studies of the application of these scoring guides. The guides used in the hand scoring were sets of nominal (descriptive) category systems. No attempt was made to arrange the categories along any ordinal continuum according to either quality or content. However, categories were considered to be either acceptable or unacceptable. The readers were given a scoring guide in which each category is given a descriptive title and illustrated by a number of sample responses. (RC) Primary type of information provided by report: Procedures (Scoring).
Accession Number: ED133350
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED133350
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED133350
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Category Scoring Techniques from National Assessment: Applications to Free Response Items from Career and Occupational Development.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Phillips%2C+Donald+L%2E%22">Phillips, Donald L.</searchLink><br /><searchLink fieldCode="AR" term="%22Education+Commission+of+the+States%2C+Denver%2C+CO%2E+National+Assessment+of+Educational+Progress%2E%22">Education Commission of the States, Denver, CO. National Assessment of Educational Progress.</searchLink>
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink><br /><searchLink fieldCode="DE" term="%22Essay+Tests%22">Essay Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Guides%22">Guides</searchLink><br /><searchLink fieldCode="DE" term="%22National+Surveys%22">National Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Occupational+Tests%22">Occupational Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability%22">Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Adults%22">Young Adults</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22National+Assessment+of+Educational+Progress%22">National Assessment of Educational Progress</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The Career and Occupational Development (COD) assessment of the National Assessment of Educational Progress (NAEP) was made up of about 70 percent free response exercises requiring hand scoring. This paper describes the techniques used in developing the "scoring guides" for these exercises and summarizes the results of two empirical studies of the application of these scoring guides. The guides used in the hand scoring were sets of nominal (descriptive) category systems. No attempt was made to arrange the categories along any ordinal continuum according to either quality or content. However, categories were considered to be either acceptable or unacceptable. The readers were given a scoring guide in which each category is given a descriptive title and illustrated by a number of sample responses. (RC) Primary type of information provided by report: Procedures (Scoring).
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED133350
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED133350
RecordInfo BibRecord:
  BibEntity:
    PhysicalDescription:
      Pagination:
        PageCount: 18
    Subjects:
      – SubjectFull: Elementary Secondary Education
        Type: general
      – SubjectFull: Essay Tests
        Type: general
      – SubjectFull: Guides
        Type: general
      – SubjectFull: National Surveys
        Type: general
      – SubjectFull: Occupational Tests
        Type: general
      – SubjectFull: Reliability
        Type: general
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Young Adults
        Type: general
      – SubjectFull: National Assessment of Educational Progress
        Type: general
    Titles:
      – TitleFull: Category Scoring Techniques from National Assessment: Applications to Free Response Items from Career and Occupational Development.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Education Commission of the States, Denver, CO. National Assessment of Educational Progress.
      – PersonEntity:
          Name:
            NameFull: Phillips, Donald L.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2025
ResultId 1