ERIC Number: EJ1348275
Record Type: Journal
Publication Date: 2022-Jun
Pages: 27
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1092-4388
EISSN: EISSN-1558-9102
Available Date: N/A
The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech
Crandell, Hannah A.; Silcox, Jack W.; Ferguson, Sarah H.; Lohani, Monika; Payne, Brennan R.
Journal of Speech, Language, and Hearing Research, v65 n6 p2364-2390 Jun 2022
Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate.
Descriptors: Visual Aids, Video Technology, Layout (Publications), Error Patterns, Hearing Impairments, Deafness, Assistive Technology, Speech Communication, Older Adults, Listening, Recall (Psychology), Acoustics, Young Adults
American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A