View in EDS HTML Full Text PDF Full Text

Improving Creativity Performance Assessment: A Rater Effect Examination with Many Facet Rasch Model.

Saved in:
Bibliographic Details
Title: Improving Creativity Performance Assessment: A Rater Effect Examination with Many Facet Rasch Model.
Authors: Hung, Su-Pin (AUTHOR), Chen, Po-Hsi (AUTHOR), Chen, Hsueh-Chih (AUTHOR)
Source: Creativity Research Journal. 2012, Vol. 24 Issue 4, p345-357. 13p. 5 Charts, 2 Graphs.
Subjects: Creative ability, Rasch models, Measurement errors, Principal components analysis, Computer simulation
Abstract: Product assessment is widely applied in creative studies, typically as an important dependent measure. Within this context, this study had 2 purposes. First, the focus of this research was on methods for investigating possible rater effects, an issue that has not received a great deal of attention in past creativity studies. Second, the substantive question of whether restrictions on materials used and differences in instructions provided would influence outcomes on measures of creativity was considered. The many-facet Rasch model was used to investigate possible sources of rater bias, including the leniency/severity effect, central tendency effect, halo effect and randomness effect. No indications were found that these potential sources of bias strongly influenced the ratings. The result indicated that the examinees could be reliably differentiated in terms of their performance. Analysis of rater-criterion interactions depicted rater behavior more clearly and, it is suggested, can be of use as a tool for rater training in future studies. In terms of the substantive questions posed, 2 × 2 experimental instructions were manipulated and it was found that different instructions did not affect creative performance. The implications of these findings are discussed. [ABSTRACT FROM AUTHOR]
Copyright of Creativity Research Journal is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 83468187
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Improving Creativity Performance Assessment: A Rater Effect Examination with Many Facet Rasch Model.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hung%2C+Su-Pin%22">Hung, Su-Pin</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Po-Hsi%22">Chen, Po-Hsi</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Hsueh-Chih%22">Chen, Hsueh-Chih</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Creativity+Research+Journal%22">Creativity Research Journal</searchLink>. 2012, Vol. 24 Issue 4, p345-357. 13p. 5 Charts, 2 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Creative+ability%22">Creative ability</searchLink><br /><searchLink fieldCode="DE" term="%22Rasch+models%22">Rasch models</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement+errors%22">Measurement errors</searchLink><br /><searchLink fieldCode="DE" term="%22Principal+components+analysis%22">Principal components analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+simulation%22">Computer simulation</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Product assessment is widely applied in creative studies, typically as an important dependent measure. Within this context, this study had 2 purposes. First, the focus of this research was on methods for investigating possible rater effects, an issue that has not received a great deal of attention in past creativity studies. Second, the substantive question of whether restrictions on materials used and differences in instructions provided would influence outcomes on measures of creativity was considered. The many-facet Rasch model was used to investigate possible sources of rater bias, including the leniency/severity effect, central tendency effect, halo effect and randomness effect. No indications were found that these potential sources of bias strongly influenced the ratings. The result indicated that the examinees could be reliably differentiated in terms of their performance. Analysis of rater-criterion interactions depicted rater behavior more clearly and, it is suggested, can be of use as a tool for rater training in future studies. In terms of the substantive questions posed, 2 × 2 experimental instructions were manipulated and it was found that different instructions did not affect creative performance. The implications of these findings are discussed. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Creativity Research Journal is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=83468187
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10400419.2012.730331
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 345
    Subjects:
      – SubjectFull: Creative ability
        Type: general
      – SubjectFull: Rasch models
        Type: general
      – SubjectFull: Measurement errors
        Type: general
      – SubjectFull: Principal components analysis
        Type: general
      – SubjectFull: Computer simulation
        Type: general
    Titles:
      – TitleFull: Improving Creativity Performance Assessment: A Rater Effect Examination with Many Facet Rasch Model.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hung, Su-Pin
      – PersonEntity:
          Name:
            NameFull: Chen, Po-Hsi
      – PersonEntity:
          Name:
            NameFull: Chen, Hsueh-Chih
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 10
              Text: 2012
              Type: published
              Y: 2012
          Identifiers:
            – Type: issn-print
              Value: 10400419
          Numbering:
            – Type: volume
              Value: 24
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Creativity Research Journal
              Type: main
ResultId 1