Bibliographic Details
| Title: |
Imperfect Captions Paired to Audiovisual Stimuli Improve Speech Recognition but Do Not Reduce Listening-Related Fatigue. |
| Authors: |
Esser, Katie1, Picou, Erin M.2, Hornsby, Benjamin W. Y.2 ben.hornsby@vumc.org |
| Source: |
American Journal of Audiology. Sep2025, Vol. 34 Issue 3, p661-675. 15p. |
| Subject Terms: |
*Audiovisual materials, *Cognitive testing, *Data analysis, *Fatigue (Physiology), *Listening, *Audiometry, *Pre-tests & post-tests, *Memory, *Speech perception, *Automation, *Hearing disorders, *Comparative studies, *Adults, Automatic speech recognition, Sensory stimulation, Task performance, Ecology, Research funding, Speech, Statistical sampling, Empirical research, Treatment effectiveness, Randomized controlled trials, Descriptive statistics, Analysis of variance, Statistics, Data analysis software |
| Abstract: |
Purpose: Understanding speech in challenging environments can be fatiguing for individuals with and without hearing loss. Empirical research examining interventions to reduce such fatigue, however, is limited. Our study investigated the effects of imperfect captions, such as those created using automated speech recognition systems, on listening-related fatigue during a challenging speech task. Method: Twenty-two adults (aged 18--63 years) with essentially normal hearing completed a sustained dual task designed to induce listening-related fatigue. The primary task was audiovisual sentence recognition in quiet, with speech levels individually adjusted for ~70% correct performance (without captions). The secondary task was response time (RT) to topic words presented during the speech task. Participants completed the dual task with or without captions. Subjective fatigue ratings were obtained before, during, and after the dual task. Vigilant attention was measured via the secondary task and before and after the dual task using visual stimuli (RTs to a visual marker presented at random intervals). Results: Subjective fatigue ratings increased significantly over the course of the dual task. However, this increase was larger for the group who had captions, even though they had better sentence recognition overall. Evidence of behavioral fatigue (slowed RTs over time) was also present but only for those in the Caption group. Anecdotal reports from study participants suggest that the increased fatigue for the Caption group was related to the cognitive challenge of combining information from the time-locked audiovisual cues and the time-delayed, and imperfect, text captions. Conclusions: Even though they were time-delayed and contained inaccuracies, captions improved speech recognition. However, this benefit was accompanied by greater increases in subjective and behavioral fatigue. Therefore, in some conditions imperfect captions can have negative consequences for listening-related fatigue. Further research is needed to determine whether this pattern holds in different circumstances, such as with audio-only stimuli. Supplemental Material: https://doi.org/10.23641/asha.29646482 [ABSTRACT FROM AUTHOR] |
|
Copyright of American Journal of Audiology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Database: |
Education Research Complete |
