Audiovisual Integration in Cued Speech Perception: Impact on Speech Recognition in Quiet and Noise Among Adults With Hearing Loss and Those With Typical Hearing.
Saved in:
| Title: | Audiovisual Integration in Cued Speech Perception: Impact on Speech Recognition in Quiet and Noise Among Adults With Hearing Loss and Those With Typical Hearing. |
|---|---|
| Authors: | Caron, Cora Jirschik1 cora.jirschik.caron@ulb.be, Vilain, Coriandre2, Schwartz, Jean-Luc2, Leybaert, Jacqueline1, Colina, Cécile |
| Source: | Journal of Speech, Language & Hearing Research. Aug2025, Vol. 68 Issue 8, p4158-4176. 19p. |
| Subject Terms: | *Audiovisual materials, *Data analysis, *Audiometry, *Intelligibility of speech, *Experimental design, *Body language, *Speech evaluation, *Speech perception, *Hearing disorders, *Hearing, *Comparative studies, *Auditory perception, *Adults, Poisson distribution, Prompts (Psychology), Noise, Ecology, Research funding, Task performance, Kruskal-Wallis Test, Chi-squared test, Age distribution, Descriptive statistics, Statistics, Acoustic stimulation, Data analysis software, Calibration, Hard of hearing people |
| Abstract: | Purpose: This study aimed to investigate audiovisual (AV) integration of cued speech (CS) gestures with the auditory input presented in quiet and amidst noise while controlling for visual speech decoding. Additionally, the study considered participants' auditory status and auditory abilities as well as their abilities to produce and decode CS in speech perception. Method: Thirty-one adults with hearing loss (HL) and proficient in CS decoding participated, alongside 52 adults with typical hearing (TH), consisting of 14 CS interpreters and 38 individuals naive regarding the system. The study employed a speech recognition test that presented CS gestures, lipreading, and lipreading integrated with CS gestures, either without sound or combined with speech sounds in quiet or amidst noise. Results: Participants with HL and lower auditory abilities integrated the auditory input with CS gestures and increased their recognition scores by 44% in quiet conditions of speech recognition. For participants with HL and higher auditory abilities, integrating CS gestures with the auditory input mixed with noise increased recognition scores by 43.1% over the auditory-only condition. For all participants with HL, CS integrated with lipreading produced optimal recognition regardless of their auditory abilities, while for those with TH, adding CS gestures did not enhance lipreading, and AV benefits were observed only when lipreading was integrated with the auditory input presented amidst noise. Conclusions: Individuals with HL are able to integrate CS gestures with auditory input. Visually supporting auditory speech with CS gestures improves speech recognition in noise and also in quiet conditions of communication for participants with HL and low auditory abilities. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 187402286 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Audiovisual Integration in Cued Speech Perception: Impact on Speech Recognition in Quiet and Noise Among Adults With Hearing Loss and Those With Typical Hearing. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Caron%2C+Cora+Jirschik%22">Caron, Cora Jirschik</searchLink><relatesTo>1</relatesTo><i> cora.jirschik.caron@ulb.be</i><br /><searchLink fieldCode="AR" term="%22Vilain%2C+Coriandre%22">Vilain, Coriandre</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Schwartz%2C+Jean-Luc%22">Schwartz, Jean-Luc</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Leybaert%2C+Jacqueline%22">Leybaert, Jacqueline</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Colina%2C+Cécile%22">Colina, Cécile</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Speech%2C+Language+%26+Hearing+Research%22">Journal of Speech, Language & Hearing Research</searchLink>. Aug2025, Vol. 68 Issue 8, p4158-4176. 19p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Audiovisual+materials%22">Audiovisual materials</searchLink><br />*<searchLink fieldCode="DE" term="%22Data+analysis%22">Data analysis</searchLink><br />*<searchLink fieldCode="DE" term="%22Audiometry%22">Audiometry</searchLink><br />*<searchLink fieldCode="DE" term="%22Intelligibility+of+speech%22">Intelligibility of speech</searchLink><br />*<searchLink fieldCode="DE" term="%22Experimental+design%22">Experimental design</searchLink><br />*<searchLink fieldCode="DE" term="%22Body+language%22">Body language</searchLink><br />*<searchLink fieldCode="DE" term="%22Speech+evaluation%22">Speech evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22Speech+perception%22">Speech perception</searchLink><br />*<searchLink fieldCode="DE" term="%22Hearing+disorders%22">Hearing disorders</searchLink><br />*<searchLink fieldCode="DE" term="%22Hearing%22">Hearing</searchLink><br />*<searchLink fieldCode="DE" term="%22Comparative+studies%22">Comparative studies</searchLink><br />*<searchLink fieldCode="DE" term="%22Auditory+perception%22">Auditory perception</searchLink><br />*<searchLink fieldCode="DE" term="%22Adults%22">Adults</searchLink><br /><searchLink fieldCode="DE" term="%22Poisson+distribution%22">Poisson distribution</searchLink><br /><searchLink fieldCode="DE" term="%22Prompts+%28Psychology%29%22">Prompts (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Noise%22">Noise</searchLink><br /><searchLink fieldCode="DE" term="%22Ecology%22">Ecology</searchLink><br /><searchLink fieldCode="DE" term="%22Research+funding%22">Research funding</searchLink><br /><searchLink fieldCode="DE" term="%22Task+performance%22">Task performance</searchLink><br /><searchLink fieldCode="DE" term="%22Kruskal-Wallis+Test%22">Kruskal-Wallis Test</searchLink><br /><searchLink fieldCode="DE" term="%22Chi-squared+test%22">Chi-squared test</searchLink><br /><searchLink fieldCode="DE" term="%22Age+distribution%22">Age distribution</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Acoustic+stimulation%22">Acoustic stimulation</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis+software%22">Data analysis software</searchLink><br /><searchLink fieldCode="DE" term="%22Calibration%22">Calibration</searchLink><br /><searchLink fieldCode="DE" term="%22Hard+of+hearing+people%22">Hard of hearing people</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Purpose: This study aimed to investigate audiovisual (AV) integration of cued speech (CS) gestures with the auditory input presented in quiet and amidst noise while controlling for visual speech decoding. Additionally, the study considered participants' auditory status and auditory abilities as well as their abilities to produce and decode CS in speech perception. Method: Thirty-one adults with hearing loss (HL) and proficient in CS decoding participated, alongside 52 adults with typical hearing (TH), consisting of 14 CS interpreters and 38 individuals naive regarding the system. The study employed a speech recognition test that presented CS gestures, lipreading, and lipreading integrated with CS gestures, either without sound or combined with speech sounds in quiet or amidst noise. Results: Participants with HL and lower auditory abilities integrated the auditory input with CS gestures and increased their recognition scores by 44% in quiet conditions of speech recognition. For participants with HL and higher auditory abilities, integrating CS gestures with the auditory input mixed with noise increased recognition scores by 43.1% over the auditory-only condition. For all participants with HL, CS integrated with lipreading produced optimal recognition regardless of their auditory abilities, while for those with TH, adding CS gestures did not enhance lipreading, and AV benefits were observed only when lipreading was integrated with the auditory input presented amidst noise. Conclusions: Individuals with HL are able to integrate CS gestures with auditory input. Visually supporting auditory speech with CS gestures improves speech recognition in noise and also in quiet conditions of communication for participants with HL and low auditory abilities. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=187402286 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1044/2025_JSLHR-24-00334 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 19 StartPage: 4158 Subjects: – SubjectFull: Audiovisual materials Type: general – SubjectFull: Data analysis Type: general – SubjectFull: Audiometry Type: general – SubjectFull: Intelligibility of speech Type: general – SubjectFull: Experimental design Type: general – SubjectFull: Body language Type: general – SubjectFull: Speech evaluation Type: general – SubjectFull: Speech perception Type: general – SubjectFull: Hearing disorders Type: general – SubjectFull: Hearing Type: general – SubjectFull: Comparative studies Type: general – SubjectFull: Auditory perception Type: general – SubjectFull: Adults Type: general – SubjectFull: Poisson distribution Type: general – SubjectFull: Prompts (Psychology) Type: general – SubjectFull: Noise Type: general – SubjectFull: Ecology Type: general – SubjectFull: Research funding Type: general – SubjectFull: Task performance Type: general – SubjectFull: Kruskal-Wallis Test Type: general – SubjectFull: Chi-squared test Type: general – SubjectFull: Age distribution Type: general – SubjectFull: Descriptive statistics Type: general – SubjectFull: Statistics Type: general – SubjectFull: Acoustic stimulation Type: general – SubjectFull: Data analysis software Type: general – SubjectFull: Calibration Type: general – SubjectFull: Hard of hearing people Type: general Titles: – TitleFull: Audiovisual Integration in Cued Speech Perception: Impact on Speech Recognition in Quiet and Noise Among Adults With Hearing Loss and Those With Typical Hearing. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Caron, Cora Jirschik – PersonEntity: Name: NameFull: Vilain, Coriandre – PersonEntity: Name: NameFull: Schwartz, Jean-Luc – PersonEntity: Name: NameFull: Leybaert, Jacqueline – PersonEntity: Name: NameFull: Colina, Cécile IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 08 Text: Aug2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 10924388 Numbering: – Type: volume Value: 68 – Type: issue Value: 8 Titles: – TitleFull: Journal of Speech, Language & Hearing Research Type: main |
| ResultId | 1 |