View in EDS

Constructing and Validating a Q-Matrix for Cognitive Diagnostic Analysis of the Listening Comprehension Section of the IELTS

Saved in:
Bibliographic Details
Title: Constructing and Validating a Q-Matrix for Cognitive Diagnostic Analysis of the Listening Comprehension Section of the IELTS
Language: English
Authors: Seyedeh Azadeh Ghiasian, Fatemeh Hemmati, Seyyed Mohammad Alavi, Afsar Rouhi
Source: International Journal of Language Testing. 2025 15(1):54-76.
Availability: Tabaran Institute of Higher Education. Shariati 60, Shariati Blvd, Ghasem Abad, Mashhad, Khorasan Razavi, Iran. Tel: +98 (51) 35227215; e-mail: ijlt@tabaran.ac.ir; Web site: http://www.ijlt.ir/
Peer Reviewed: Y
Page Count: 23
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Adult Education
Descriptors: Test Items, Listening Comprehension Tests, English (Second Language), Language Tests, Second Language Learning, Foreign Countries, Intonation, Suprasegmentals, Test Validity, Item Analysis, Phrase Structure, Language Processing, Inferences, Goodness of Fit, College Students, Adult Students, Auditory Discrimination
Geographic Terms: Iran
Assessment and Survey Identifiers: International English Language Testing System
ISSN: 2476-5880
Abstract: A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a listening comprehension test of the IELTS was administered to 820 Iranian test takers. According to theories, taxonomies, and models of second/foreign language (L2) listening comprehension, previous studies on the utility of CDMs to L2 listening comprehension, detailed content analysis of the test items, and consultation with several content experts, an initial Q-matrix was first developed. Through the technique suggested by de la Torre and Chiu (2016), along with checking heatmap plots and mesa plots using the GDINA package in R, the Q-matrix was then empirically validated. Generally, six attributes were extracted for the listening section, namely, (1) Linguistic knowledge (LKA), (2) understanding prosodic patterns (UPP), (3) ability to understand and make paraphrases (PAR), (4) ability to understand specific factual information such as names, numbers, and so forth (UFI), (5) ability to understand explicit information (UEI), and (6) ability to make inference (INF). Finally, the results of the fit of the GDINA model to the data, at both item and test levels, indicated the adequate model-data fit and the plausibility of the Q-matrix. The implications of the study were also discussed.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1463868
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1463868
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1463868
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Constructing and Validating a Q-Matrix for Cognitive Diagnostic Analysis of the Listening Comprehension Section of the IELTS
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Seyedeh+Azadeh+Ghiasian%22">Seyedeh Azadeh Ghiasian</searchLink><br /><searchLink fieldCode="AR" term="%22Fatemeh+Hemmati%22">Fatemeh Hemmati</searchLink><br /><searchLink fieldCode="AR" term="%22Seyyed+Mohammad+Alavi%22">Seyyed Mohammad Alavi</searchLink><br /><searchLink fieldCode="AR" term="%22Afsar+Rouhi%22">Afsar Rouhi</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Language+Testing%22"><i>International Journal of Language Testing</i></searchLink>. 2025 15(1):54-76.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Tabaran Institute of Higher Education. Shariati 60, Shariati Blvd, Ghasem Abad, Mashhad, Khorasan Razavi, Iran. Tel: +98 (51) 35227215; e-mail: ijlt@tabaran.ac.ir; Web site: http://www.ijlt.ir/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Adult+Education%22">Adult Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Listening+Comprehension+Tests%22">Listening Comprehension Tests</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Intonation%22">Intonation</searchLink><br /><searchLink fieldCode="DE" term="%22Suprasegmentals%22">Suprasegmentals</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Phrase+Structure%22">Phrase Structure</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Processing%22">Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Inferences%22">Inferences</searchLink><br /><searchLink fieldCode="DE" term="%22Goodness+of+Fit%22">Goodness of Fit</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Adult+Students%22">Adult Students</searchLink><br /><searchLink fieldCode="DE" term="%22Auditory+Discrimination%22">Auditory Discrimination</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Iran%22">Iran</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22International+English+Language+Testing+System%22">International English Language Testing System</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2476-5880
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a listening comprehension test of the IELTS was administered to 820 Iranian test takers. According to theories, taxonomies, and models of second/foreign language (L2) listening comprehension, previous studies on the utility of CDMs to L2 listening comprehension, detailed content analysis of the test items, and consultation with several content experts, an initial Q-matrix was first developed. Through the technique suggested by de la Torre and Chiu (2016), along with checking heatmap plots and mesa plots using the GDINA package in R, the Q-matrix was then empirically validated. Generally, six attributes were extracted for the listening section, namely, (1) Linguistic knowledge (LKA), (2) understanding prosodic patterns (UPP), (3) ability to understand and make paraphrases (PAR), (4) ability to understand specific factual information such as names, numbers, and so forth (UFI), (5) ability to understand explicit information (UEI), and (6) ability to make inference (INF). Finally, the results of the fit of the GDINA model to the data, at both item and test levels, indicated the adequate model-data fit and the plausibility of the Q-matrix. The implications of the study were also discussed.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1463868
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1463868
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
        StartPage: 54
    Subjects:
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Listening Comprehension Tests
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Intonation
        Type: general
      – SubjectFull: Suprasegmentals
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Phrase Structure
        Type: general
      – SubjectFull: Language Processing
        Type: general
      – SubjectFull: Inferences
        Type: general
      – SubjectFull: Goodness of Fit
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Adult Students
        Type: general
      – SubjectFull: Auditory Discrimination
        Type: general
      – SubjectFull: Iran
        Type: general
      – SubjectFull: International English Language Testing System
        Type: general
    Titles:
      – TitleFull: Constructing and Validating a Q-Matrix for Cognitive Diagnostic Analysis of the Listening Comprehension Section of the IELTS
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Seyedeh Azadeh Ghiasian
      – PersonEntity:
          Name:
            NameFull: Fatemeh Hemmati
      – PersonEntity:
          Name:
            NameFull: Seyyed Mohammad Alavi
      – PersonEntity:
          Name:
            NameFull: Afsar Rouhi
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2476-5880
          Numbering:
            – Type: volume
              Value: 15
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: International Journal of Language Testing
              Type: main
ResultId 1