View in EDS

A Rasch Analysis of the Self-Determination, Purpose, Identity, and Engagement in Science (SPIRES) Survey: Instrument Validation and Recommendations

Saved in:
Bibliographic Details
Title: A Rasch Analysis of the Self-Determination, Purpose, Identity, and Engagement in Science (SPIRES) Survey: Instrument Validation and Recommendations
Language: English
Authors: Courtney Donovan (ORCID 0000-0001-5911-3294), Hannah Huvard (ORCID 0000-0003-0799-8814), Angela Rexwinkle (ORCID 0009-0007-6162-0878), Robert Talbot (ORCID 0000-0002-6821-0675)
Source: International Journal of Education in Mathematics, Science and Technology. 2025 13(4):992-1015.
Availability: International Journal of Education in Mathematics, Science and Technology. Necmettin Erbakan University, Ahmet Kelesoglu Education Faculty, Meram, Konya, 42090, Turkey. e-mail: ijermst@gmail.com; Web site: https://www.ijemst.net/index.php/ijemst/index
Peer Reviewed: Y
Page Count: 25
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Item Response Theory, Student Surveys, Test Validity, Student Motivation, Undergraduate Students, Biology, Self Concept, Learner Engagement, Identification (Psychology), Scientists, Peer Relationship
ISSN: 2147-611X
Abstract: The purpose of the present study was to perform a cross-validation of an existing measure of science students' motivational traits using the Rasch modeling approach. The validity of the Self-determination, Purpose, Identity, and Engagement in Science (SPIRES) survey was originally investigated using factor analysis, but a secondary validation of this instrument has not yet been published. This is a recommended practice when using a psychometric instrument within a new context or with a different student population. In this validity study, we took a Rasch modeling approach instead of factor analysis because, unlike factor analysis, Rasch modeling is sample-independent. The original factor analysis validation of the SPIRES suggested the survey is composed of three larger ideas or constructs, while our Rasch modeling results suggest there are four constructs. Since our Rasch analyses were sample-independent, we conclude that the SPIRES survey is a four construct survey and may be treated as such across educational contexts without further need to validate using factor analysis, which could continuously produce inconsistent results. These results provide the basis for a validity argument for researchers using the SPIRES in their work. Our work also demonstrates an advantage to using a Rasch modeling approach over factor analysis for instrument validation.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1475652
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1475652
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1475652
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Rasch Analysis of the Self-Determination, Purpose, Identity, and Engagement in Science (SPIRES) Survey: Instrument Validation and Recommendations
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Courtney+Donovan%22">Courtney Donovan</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5911-3294">0000-0001-5911-3294</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hannah+Huvard%22">Hannah Huvard</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-0799-8814">0000-0003-0799-8814</externalLink>)<br /><searchLink fieldCode="AR" term="%22Angela+Rexwinkle%22">Angela Rexwinkle</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0007-6162-0878">0009-0007-6162-0878</externalLink>)<br /><searchLink fieldCode="AR" term="%22Robert+Talbot%22">Robert Talbot</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6821-0675">0000-0002-6821-0675</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Education+in+Mathematics%2C+Science+and+Technology%22"><i>International Journal of Education in Mathematics, Science and Technology</i></searchLink>. 2025 13(4):992-1015.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Journal of Education in Mathematics, Science and Technology. Necmettin Erbakan University, Ahmet Kelesoglu Education Faculty, Meram, Konya, 42090, Turkey. e-mail: ijermst@gmail.com; Web site: https://www.ijemst.net/index.php/ijemst/index
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 25
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Surveys%22">Student Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Motivation%22">Student Motivation</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Biology%22">Biology</searchLink><br /><searchLink fieldCode="DE" term="%22Self+Concept%22">Self Concept</searchLink><br /><searchLink fieldCode="DE" term="%22Learner+Engagement%22">Learner Engagement</searchLink><br /><searchLink fieldCode="DE" term="%22Identification+%28Psychology%29%22">Identification (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Scientists%22">Scientists</searchLink><br /><searchLink fieldCode="DE" term="%22Peer+Relationship%22">Peer Relationship</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2147-611X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The purpose of the present study was to perform a cross-validation of an existing measure of science students' motivational traits using the Rasch modeling approach. The validity of the Self-determination, Purpose, Identity, and Engagement in Science (SPIRES) survey was originally investigated using factor analysis, but a secondary validation of this instrument has not yet been published. This is a recommended practice when using a psychometric instrument within a new context or with a different student population. In this validity study, we took a Rasch modeling approach instead of factor analysis because, unlike factor analysis, Rasch modeling is sample-independent. The original factor analysis validation of the SPIRES suggested the survey is composed of three larger ideas or constructs, while our Rasch modeling results suggest there are four constructs. Since our Rasch analyses were sample-independent, we conclude that the SPIRES survey is a four construct survey and may be treated as such across educational contexts without further need to validate using factor analysis, which could continuously produce inconsistent results. These results provide the basis for a validity argument for researchers using the SPIRES in their work. Our work also demonstrates an advantage to using a Rasch modeling approach over factor analysis for instrument validation.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1475652
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1475652
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 992
    Subjects:
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Student Surveys
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Student Motivation
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Biology
        Type: general
      – SubjectFull: Self Concept
        Type: general
      – SubjectFull: Learner Engagement
        Type: general
      – SubjectFull: Identification (Psychology)
        Type: general
      – SubjectFull: Scientists
        Type: general
      – SubjectFull: Peer Relationship
        Type: general
    Titles:
      – TitleFull: A Rasch Analysis of the Self-Determination, Purpose, Identity, and Engagement in Science (SPIRES) Survey: Instrument Validation and Recommendations
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Courtney Donovan
      – PersonEntity:
          Name:
            NameFull: Hannah Huvard
      – PersonEntity:
          Name:
            NameFull: Angela Rexwinkle
      – PersonEntity:
          Name:
            NameFull: Robert Talbot
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2147-611X
          Numbering:
            – Type: volume
              Value: 13
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: International Journal of Education in Mathematics, Science and Technology
              Type: main
ResultId 1