Advances in the Identification and Agreement About Meta-Therapy for Voice Disorders: A Methodological Paper.

Saved in:

Bibliographic Details
Title:	Advances in the Identification and Agreement About Meta-Therapy for Voice Disorders: A Methodological Paper.
Authors:	Martineau, Sarah^1,2,3,4 sarah.martineau@pm.me, Ménard, Pierre André⁴, Gartner-Schmidt, Jackie⁵, Helou, Leah Bernadette³, Estes, Christine Murphy⁶, Hammerle, Brianna K.⁷, Litts, Juliana K.⁸, Rosenberg, Marci⁹, Schmura, Erin¹⁰, Ratté, Sylvie⁴
Source:	Journal of Speech, Language & Hearing Research. Jun2026, Vol. 69 Issue 6, p2481-2497. 17p.
Subject Terms:	Conversation, Speech-language pathology, Research bias, Research, Cognitive therapy, Speech therapy, Voice disorder treatment, Consensus (Social sciences), Research funding, Natural language processing, Descriptive statistics, Linguistics, Conceptual structures, Patient-professional relations
Abstract:	Background: Meta-therapy (MT) is a powerful dialogue-based element of voice therapy that scaffolds patients' cognitive models of treatment. MT dialogues have not historically been taught in an explicit manner, and substantial variability in identifying MT exists within and across clinicians. This low reliability is problematic for empirical research and educational transfer. Harnessing contemporary natural language processing technologies to stress test the concept of MT and its clinical instances may enhance our theoretical and empirical grasp of the construct. Method: To capture crucial therapeutic component parts and MT, 10,443 clinician utterances stemming from conversation training therapy sessions delivered by six expert voice-specialized speech-language pathologists were transcribed and analyzed with a refined annotation framework. Two independent raters annotated each session and reconciled disagreements through adjudication, and the resulting consensus was compared with an expert gold standard. Time distribution was analyzed. Linguistic profiles were derived from bigram frequencies in utterances reaching expert-annotator consensus. Reliability and ambiguity in identification were assessed with multilabel confusion matrices, percentage agreement, Cohen's kappa, and Gwet's agreement coefficient (AC1). Results: Gwet's AC1 indicated substantial-to-almost-perfect agreement for MT in most sessions, outperforming κ and mitigating base-rate artifacts (AC1: up to .98). Mean stand-alone MT duration ranged from 0.32 to 3.88 min per session. Distinctive MT bigrams contrasted with motor practice or psychosocial collocations that typified direct and counseling content, although lexical overlap produced systematic confusions with MT blended with direct and education/indirect label s. Conclusions: The revised annotation model markedly improved the reproducibility of MT identification and revealed its linguistic signature. The model confirmed MT's role as a cross-cutting discourse that integrates with other therapeutic modalities. These advances provide an empirical foundation for machine learning classifiers, formal curriculum content, and further investigation into MT's contribution to treatment efficacy. [ABSTRACT FROM AUTHOR]
	Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Education Research Complete

Description
Abstract:	Background: Meta-therapy (MT) is a powerful dialogue-based element of voice therapy that scaffolds patients' cognitive models of treatment. MT dialogues have not historically been taught in an explicit manner, and substantial variability in identifying MT exists within and across clinicians. This low reliability is problematic for empirical research and educational transfer. Harnessing contemporary natural language processing technologies to stress test the concept of MT and its clinical instances may enhance our theoretical and empirical grasp of the construct. Method: To capture crucial therapeutic component parts and MT, 10,443 clinician utterances stemming from conversation training therapy sessions delivered by six expert voice-specialized speech-language pathologists were transcribed and analyzed with a refined annotation framework. Two independent raters annotated each session and reconciled disagreements through adjudication, and the resulting consensus was compared with an expert gold standard. Time distribution was analyzed. Linguistic profiles were derived from bigram frequencies in utterances reaching expert-annotator consensus. Reliability and ambiguity in identification were assessed with multilabel confusion matrices, percentage agreement, Cohen's kappa, and Gwet's agreement coefficient (AC1). Results: Gwet's AC1 indicated substantial-to-almost-perfect agreement for MT in most sessions, outperforming κ and mitigating base-rate artifacts (AC1: up to .98). Mean stand-alone MT duration ranged from 0.32 to 3.88 min per session. Distinctive MT bigrams contrasted with motor practice or psychosocial collocations that typified direct and counseling content, although lexical overlap produced systematic confusions with MT blended with direct and education/indirect label s. Conclusions: The revised annotation model markedly improved the reproducibility of MT identification and revealed its linguistic signature. The model confirmed MT's role as a cross-cutting discourse that integrates with other therapeutic modalities. These advances provide an empirical foundation for machine learning classifiers, formal curriculum content, and further investigation into MT's contribution to treatment efficacy. [ABSTRACT FROM AUTHOR]
ISSN:	10924388
DOI:	10.1044/2026_JSLHR-25-00697