Multilevel Cognitive Diagnosis Models for Assessing Changes in Latent Attributes
Saved in:
| Title: | Multilevel Cognitive Diagnosis Models for Assessing Changes in Latent Attributes |
|---|---|
| Language: | English |
| Authors: | Huang, Hung-Yu |
| Source: | Journal of Educational Measurement. Win 2017 54(4):440-480. |
| Availability: | Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA |
| Peer Reviewed: | Y |
| Page Count: | 41 |
| Publication Date: | 2017 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Testing, Cognitive Measurement, Test Items, Classification, Accuracy, Goodness of Fit, Cognitive Structures, Longitudinal Studies |
| DOI: | 10.1111/jedm.12156/abstract |
| ISSN: | 0022-0655 |
| Abstract: | Cognitive diagnosis models (CDMs) have been developed to evaluate the mastery status of individuals with respect to a set of defined attributes or skills that are measured through testing. When individuals are repeatedly administered a cognitive diagnosis test, a new class of multilevel CDMs is required to assess the changes in their attributes and simultaneously estimate the model parameters from the different measurements. In this study, the most general CDM of the generalized deterministic input, noisy "and" gate (G-DINA) model was extended to a multilevel higher order CDM by embedding a multilevel structure into higher order latent traits. A series of simulations based on diverse factors was conducted to assess the quality of the parameter estimation. The results demonstrate that the model parameters can be recovered fairly well and attribute mastery can be precisely estimated if the sample size is large and the test is sufficiently long. The range of the location parameters had opposing effects on the recovery of the item and person parameters. Ignoring the multilevel structure in the data by fitting a single-level G-DINA model decreased the attribute classification accuracy and the precision of latent trait estimation. The number of measurement occasions had a substantial impact on latent trait estimation. Satisfactory model and person parameter recoveries could be achieved even when assumptions of the measurement invariance of the model parameters over time were violated. A longitudinal basic ability assessment is outlined to demonstrate the application of the new models. |
| Abstractor: | As Provided |
| Entry Date: | 2017 |
| Accession Number: | EJ1162251 |
| Database: | ERIC |
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHdw6Z5_GEfi2TZALYpzgc4AAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDErCnCuCg6KdXyeHLAIBEICBmz1kKx1SCNZKWdAyIiSJnEbXAQUgI8ZTcMrreYqJCdQ3s1Tz2_vDFTIXieRQv1lhUH6lzB5DpZhFamn92bQe680kX3ar2WTA_rKzePgyCNvMoN_1lG4vSnwdEP-uX9e-eo4kmD-zfpwukewQw_iUYfw3uBYuO_BoqRJzTqpSqenjIWL11c09MViFk7mqr7McO_4XNgA97vWV6xJA Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1162251 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Multilevel Cognitive Diagnosis Models for Assessing Changes in Latent Attributes – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Huang%2C+Hung-Yu%22">Huang, Hung-Yu</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Journal+of+Educational+Measurement%22"><i>Journal of Educational Measurement</i></searchLink>. Win 2017 54(4):440-480. – Name: Avail Label: Availability Group: Avail Data: Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 41 – Name: DatePubCY Label: Publication Date Group: Date Data: 2017 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Testing%22">Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Measurement%22">Cognitive Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Classification%22">Classification</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Goodness+of+Fit%22">Goodness of Fit</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Structures%22">Cognitive Structures</searchLink><br /><searchLink fieldCode="DE" term="%22Longitudinal+Studies%22">Longitudinal Studies</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1111/jedm.12156/abstract – Name: ISSN Label: ISSN Group: ISSN Data: 0022-0655 – Name: Abstract Label: Abstract Group: Ab Data: Cognitive diagnosis models (CDMs) have been developed to evaluate the mastery status of individuals with respect to a set of defined attributes or skills that are measured through testing. When individuals are repeatedly administered a cognitive diagnosis test, a new class of multilevel CDMs is required to assess the changes in their attributes and simultaneously estimate the model parameters from the different measurements. In this study, the most general CDM of the generalized deterministic input, noisy "and" gate (G-DINA) model was extended to a multilevel higher order CDM by embedding a multilevel structure into higher order latent traits. A series of simulations based on diverse factors was conducted to assess the quality of the parameter estimation. The results demonstrate that the model parameters can be recovered fairly well and attribute mastery can be precisely estimated if the sample size is large and the test is sufficiently long. The range of the location parameters had opposing effects on the recovery of the item and person parameters. Ignoring the multilevel structure in the data by fitting a single-level G-DINA model decreased the attribute classification accuracy and the precision of latent trait estimation. The number of measurement occasions had a substantial impact on latent trait estimation. Satisfactory model and person parameter recoveries could be achieved even when assumptions of the measurement invariance of the model parameters over time were violated. A longitudinal basic ability assessment is outlined to demonstrate the application of the new models. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2017 – Name: AN Label: Accession Number Group: ID Data: EJ1162251 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1162251 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/jedm.12156/abstract Languages: – Text: English PhysicalDescription: Pagination: PageCount: 41 StartPage: 440 Subjects: – SubjectFull: Testing Type: general – SubjectFull: Cognitive Measurement Type: general – SubjectFull: Test Items Type: general – SubjectFull: Classification Type: general – SubjectFull: Accuracy Type: general – SubjectFull: Goodness of Fit Type: general – SubjectFull: Cognitive Structures Type: general – SubjectFull: Longitudinal Studies Type: general Titles: – TitleFull: Multilevel Cognitive Diagnosis Models for Assessing Changes in Latent Attributes Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Huang, Hung-Yu IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2017 Identifiers: – Type: issn-print Value: 0022-0655 Numbering: – Type: volume Value: 54 – Type: issue Value: 4 Titles: – TitleFull: Journal of Educational Measurement Type: main |
| ResultId | 1 |
