How do validity experts conceptualise argumentation? It's a rhetorical question.

Saved in:
Bibliographic Details
Title: How do validity experts conceptualise argumentation? It's a rhetorical question.
Authors: Kinnear, Benjamin, Martini, Abigail, Varpio, Lara, Driessen, Erik W., Schumacher, Daniel J.
Source: Medical Education. Aug2024, Vol. 58 Issue 8, p989-997. 9p.
Subjects: Medical education, Qualitative research, Interviewing, Authorship, Thematic analysis, Sound recordings, Research methodology, Data analysis software
Geographic Terms: Australia, Canada, United States, Netherlands
Abstract: Introduction: Health professions education (HPE) has adopted the conceptualization of validity as an argument. However, the theoretical and practical aspects of how validity arguments should be developed, used and evaluated in HPE have not been deeply explored. Articulating the argumentation theory undergirding validity and validation can help HPE better operationalise validity as an argument. To better understand this, the authors explored how HPE validity scholars conceptualise assessment validity arguments and argumentation, seeking to understand potential consequences of these views on validation practices. Methods: The authors used critical case sampling to identify HPE assessment validity experts in three ways: (1) participation in a prominent validity research group, (2) appearing in a bibliometric study of HPE validity publications and (3) authorship of recent HPE validity literature. Qualitative semi‐structured interviews were conducted with 16 experts in HPE assessment validity from four different countries. The authors used reflexive thematic analysis to develop themes relevant to their research question. Results: The authors developed three themes grounded in participants' responses: (1) In theory, HPE validity is a social and situated argument. (2) In practice, the absence of audience and evaluation stymies the social nature of HPE validity. (3) Lack of validity argumentation creates and maintains power differentials within HPE. Participants articulated that current HPE validation practices are rooted in post‐positivist epistemology when they should be situated (i.e. context‐dependent), audience‐centric and inclusive. Discussion: When discussing validity argumentation in theory, participants' descriptions reflect an interpretivist lens for evaluation that is misaligned with real‐world validity practices. This misalignment likely arises from HPE's adoption of "validity as an argument" as a slogan, without integrating theoretical and practical principles of argumentation theory. How do HPE experts conceptualize the argumentation aspect of validity? @Midwest_MedPeds @ab_martini @LaraVarpio @erikdriessen @DrDanSchumacher explore the gap between theory and practice. [ABSTRACT FROM AUTHOR]
Copyright of Medical Education is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
Description
Abstract:Introduction: Health professions education (HPE) has adopted the conceptualization of validity as an argument. However, the theoretical and practical aspects of how validity arguments should be developed, used and evaluated in HPE have not been deeply explored. Articulating the argumentation theory undergirding validity and validation can help HPE better operationalise validity as an argument. To better understand this, the authors explored how HPE validity scholars conceptualise assessment validity arguments and argumentation, seeking to understand potential consequences of these views on validation practices. Methods: The authors used critical case sampling to identify HPE assessment validity experts in three ways: (1) participation in a prominent validity research group, (2) appearing in a bibliometric study of HPE validity publications and (3) authorship of recent HPE validity literature. Qualitative semi‐structured interviews were conducted with 16 experts in HPE assessment validity from four different countries. The authors used reflexive thematic analysis to develop themes relevant to their research question. Results: The authors developed three themes grounded in participants' responses: (1) In theory, HPE validity is a social and situated argument. (2) In practice, the absence of audience and evaluation stymies the social nature of HPE validity. (3) Lack of validity argumentation creates and maintains power differentials within HPE. Participants articulated that current HPE validation practices are rooted in post‐positivist epistemology when they should be situated (i.e. context‐dependent), audience‐centric and inclusive. Discussion: When discussing validity argumentation in theory, participants' descriptions reflect an interpretivist lens for evaluation that is misaligned with real‐world validity practices. This misalignment likely arises from HPE's adoption of "validity as an argument" as a slogan, without integrating theoretical and practical principles of argumentation theory. How do HPE experts conceptualize the argumentation aspect of validity? @Midwest_MedPeds @ab_martini @LaraVarpio @erikdriessen @DrDanSchumacher explore the gap between theory and practice. [ABSTRACT FROM AUTHOR]
ISSN:03080110
DOI:10.1111/medu.15311