View in EDS

Exploring the Influence of Response Time Allocation on Item Revisiting: Implications for Test-Taking Strategies in Cognitive Diagnostic Assessments

Saved in:
Bibliographic Details
Title: Exploring the Influence of Response Time Allocation on Item Revisiting: Implications for Test-Taking Strategies in Cognitive Diagnostic Assessments
Language: English
Authors: Ziyuan Zhao (ORCID 0009-0004-5755-8205), Jiwei Zhang (ORCID 0000-0002-7454-1673), Jing Lu (ORCID 0000-0001-8333-9146)
Source: Journal of Educational Measurement. 2026 63(1).
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 27
Publication Date: 2026
Document Type: Journal Articles
Reports - Evaluative
Descriptors: Item Response Theory, Test Items, Test Wiseness, Cognitive Measurement, Diagnostic Tests, Computer Assisted Testing, Reaction Time, Accuracy, Markov Processes, Monte Carlo Methods, Bayesian Statistics
DOI: 10.1111/jedm.70021
ISSN: 0022-0655
1745-3984
Abstract: Computer-based assessments offer readily available process data for analysis to gain a deeper understanding of the response process. A common response strategy is item revisiting, which can reduce examinees' anxiety and improve their chances of answering questions correctly, and data on item revisiting are recorded automatically in system logs. The approach reported here is to combine two useful and easily accessible types of process data--item response times and item-revisiting data--with a cognitive diagnostic model to enhance accuracy, identify examinees' level of mastery in specific skills within a particular knowledge domain, and provide personalized diagnostic feedback. The modeling involves two monotonicity hypotheses: (1) examinees who engaged in more revisiting in previous items are more likely to revisit the current item; (2) a longer accumulated response time on previous items results in less remaining time, reducing the likelihood of revisiting the current item. Unlike previous studies in which response time was modeled separately, the focus here is on examinees' revisiting behavior, thus the response time is included in the revisiting modeling as a covariate. This allows an in-depth investigation of how the accumulated response time influences revisiting behavior, as well as an exploration of the relationship between response strategy (i.e., item revisiting) and time allocation. The Markov-chain Monte Carlo approach is used for parameter estimation, and its effectiveness is evaluated using two Bayesian evaluation criteria based on posterior samples. Simulation results show that this method is effective for recovering parameters, and an example analysis verifies the the proposed model.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1501280
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1501280
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Exploring the Influence of Response Time Allocation on Item Revisiting: Implications for Test-Taking Strategies in Cognitive Diagnostic Assessments
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ziyuan+Zhao%22">Ziyuan Zhao</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0004-5755-8205">0009-0004-5755-8205</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jiwei+Zhang%22">Jiwei Zhang</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7454-1673">0000-0002-7454-1673</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jing+Lu%22">Jing Lu</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-8333-9146">0000-0001-8333-9146</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Educational+Measurement%22"><i>Journal of Educational Measurement</i></searchLink>. 2026 63(1).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 27
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Wiseness%22">Test Wiseness</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Measurement%22">Cognitive Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Diagnostic+Tests%22">Diagnostic Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Reaction+Time%22">Reaction Time</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Markov+Processes%22">Markov Processes</searchLink><br /><searchLink fieldCode="DE" term="%22Monte+Carlo+Methods%22">Monte Carlo Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Bayesian+Statistics%22">Bayesian Statistics</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1111/jedm.70021
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0022-0655<br />1745-3984
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Computer-based assessments offer readily available process data for analysis to gain a deeper understanding of the response process. A common response strategy is item revisiting, which can reduce examinees' anxiety and improve their chances of answering questions correctly, and data on item revisiting are recorded automatically in system logs. The approach reported here is to combine two useful and easily accessible types of process data--item response times and item-revisiting data--with a cognitive diagnostic model to enhance accuracy, identify examinees' level of mastery in specific skills within a particular knowledge domain, and provide personalized diagnostic feedback. The modeling involves two monotonicity hypotheses: (1) examinees who engaged in more revisiting in previous items are more likely to revisit the current item; (2) a longer accumulated response time on previous items results in less remaining time, reducing the likelihood of revisiting the current item. Unlike previous studies in which response time was modeled separately, the focus here is on examinees' revisiting behavior, thus the response time is included in the revisiting modeling as a covariate. This allows an in-depth investigation of how the accumulated response time influences revisiting behavior, as well as an exploration of the relationship between response strategy (i.e., item revisiting) and time allocation. The Markov-chain Monte Carlo approach is used for parameter estimation, and its effectiveness is evaluated using two Bayesian evaluation criteria based on posterior samples. Simulation results show that this method is effective for recovering parameters, and an example analysis verifies the the proposed model.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1501280
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1501280
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/jedm.70021
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 27
    Subjects:
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Test Wiseness
        Type: general
      – SubjectFull: Cognitive Measurement
        Type: general
      – SubjectFull: Diagnostic Tests
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Reaction Time
        Type: general
      – SubjectFull: Accuracy
        Type: general
      – SubjectFull: Markov Processes
        Type: general
      – SubjectFull: Monte Carlo Methods
        Type: general
      – SubjectFull: Bayesian Statistics
        Type: general
    Titles:
      – TitleFull: Exploring the Influence of Response Time Allocation on Item Revisiting: Implications for Test-Taking Strategies in Cognitive Diagnostic Assessments
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ziyuan Zhao
      – PersonEntity:
          Name:
            NameFull: Jiwei Zhang
      – PersonEntity:
          Name:
            NameFull: Jing Lu
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 0022-0655
            – Type: issn-electronic
              Value: 1745-3984
          Numbering:
            – Type: volume
              Value: 63
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Educational Measurement
              Type: main
ResultId 1