View in EDS

A Primer on the Validity Typology and Threats to Validity in Education Research

Saved in:
Bibliographic Details
Title: A Primer on the Validity Typology and Threats to Validity in Education Research
Language: English
Authors: Kylie Anglin (ORCID 0000-0001-7661-3370), Qing Liu, Vivian C. Wong
Source: Asia Pacific Education Review. 2024 25(3):557-574.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 18
Publication Date: 2024
Document Type: Journal Articles
Reports - Descriptive
Descriptors: Educational Research, Program Evaluation, Validity, Classification, Causal Models, Inferences
DOI: 10.1007/s12564-024-09955-4
ISSN: 1598-1037
1876-407X
Abstract: Given decision-makers often prioritize causal research that identifies the impact of treatments on the people they serve, a key question in education research is, "Does it work?". Today, however, researchers are paying increasing attention to successive questions that are equally important from a practical standpoint--not only does it work, but for whom and under what circumstances? Invalid conclusions to any of these questions can result in the adoption of ineffective educational practices. This article discusses the enduring legacy of Shadish, Cook, and Campbell's validity typology, and its associated threats to validity, for improving the validity of inferences in education research. The validity typology provides a system for classifying and improving inferences related to four validity types, including ensuring a causal relationship between a treatment and outcome (internal validity) that is precisely estimated (statistical validity), well understood (construct validity), and generalizes to the necessary circumstances (external validity). Here, we provide an overview of these four validity types and discuss proactive approaches to addressing them. We conclude by discussing how the validity typology framework may help researchers understand and address contemporary critiques of quantitative causal research.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1435886
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1435886
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Primer on the Validity Typology and Threats to Validity in Education Research
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kylie+Anglin%22">Kylie Anglin</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0001-7661-3370">0000-0001-7661-3370</externalLink>)<br /><searchLink fieldCode="AR" term="%22Qing+Liu%22">Qing Liu</searchLink><br /><searchLink fieldCode="AR" term="%22Vivian+C%2E+Wong%22">Vivian C. Wong</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Asia+Pacific+Education+Review%22"><i>Asia Pacific Education Review</i></searchLink>. 2024 25(3):557-574.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Descriptive
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Evaluation%22">Program Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Classification%22">Classification</searchLink><br /><searchLink fieldCode="DE" term="%22Causal+Models%22">Causal Models</searchLink><br /><searchLink fieldCode="DE" term="%22Inferences%22">Inferences</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s12564-024-09955-4
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1598-1037<br />1876-407X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Given decision-makers often prioritize causal research that identifies the impact of treatments on the people they serve, a key question in education research is, "Does it work?". Today, however, researchers are paying increasing attention to successive questions that are equally important from a practical standpoint--not only does it work, but for whom and under what circumstances? Invalid conclusions to any of these questions can result in the adoption of ineffective educational practices. This article discusses the enduring legacy of Shadish, Cook, and Campbell's validity typology, and its associated threats to validity, for improving the validity of inferences in education research. The validity typology provides a system for classifying and improving inferences related to four validity types, including ensuring a causal relationship between a treatment and outcome (internal validity) that is precisely estimated (statistical validity), well understood (construct validity), and generalizes to the necessary circumstances (external validity). Here, we provide an overview of these four validity types and discuss proactive approaches to addressing them. We conclude by discussing how the validity typology framework may help researchers understand and address contemporary critiques of quantitative causal research.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1435886
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1435886
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s12564-024-09955-4
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 557
    Subjects:
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Program Evaluation
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Classification
        Type: general
      – SubjectFull: Causal Models
        Type: general
      – SubjectFull: Inferences
        Type: general
    Titles:
      – TitleFull: A Primer on the Validity Typology and Threats to Validity in Education Research
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kylie Anglin
      – PersonEntity:
          Name:
            NameFull: Qing Liu
      – PersonEntity:
          Name:
            NameFull: Vivian C. Wong
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 1598-1037
            – Type: issn-electronic
              Value: 1876-407X
          Numbering:
            – Type: volume
              Value: 25
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Asia Pacific Education Review
              Type: main
ResultId 1