ERIC Number: EJ1265478
Record Type: Journal
Publication Date: 2020-Jul
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1092-4388
EISSN: N/A
Available Date: N/A
An Eye-Tracking Study on Audiovisual Speech Perception Strategies Adopted by Normal-Hearing and Deaf Adults under Different Language Familiarities
Wang, Jianrong; Zhu, Yumeng; Chen, Yu; Mamat, Abdilbar; Yu, Mei; Zhang, Ju; Dang, Jianwu
Journal of Speech, Language, and Hearing Research, v63 n7 p2245--2254 Jul 2020
Purpose: The primary purpose of this study was to explore the audiovisual speech perception strategies.80.23.47 adopted by normal-hearing and deaf people in processing familiar and unfamiliar languages. Our primary hypothesis was that they would adopt different perception strategies due to different sensory experiences at an early age, limitations of the physical device, and the developmental gap of language, and others. Method: Thirty normal-hearing adults and 33 prelingually deaf adults participated in the study. They were asked to perform judgment and listening tasks while watching videos of a Uygur-Mandarin bilingual speaker in a familiar language (Standard Chinese) or an unfamiliar language (Modern Uygur) while their eye movements were recorded by eye-tracking technology. Results: Task had a slight influence on the distribution of selective attention, whereas subject and language had significant influences. To be specific, the normal-hearing and the 10 deaf participants mainly gazed at the speaker's eyes and mouth, respectively, in the experiment; moreover, while the normal-hearing participants had to stare longer at the speaker's mouth when they confronted with the unfamiliar language Modern Uygur, the deaf participant did not change their attention allocation pattern when perceiving the two languages. Conclusions: Normal-hearing and deaf adults adopt different audiovisual speech perception strategies: Normal-hearing adults mainly look at the eyes, and deaf adults mainly look at the mouth. Additionally, language and task can also modulate the speech perception strategy.
Descriptors: Eye Movements, Visual Perception, Auditory Perception, Deafness, Language Processing, Speech Communication, Familiarity, Mandarin Chinese, Turkic Languages, Attention, Tone Languages, Foreign Countries, Undergraduate Students, Young Adults, Cues, Listening, Assistive Technology, Lipreading
American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A
Author Affiliations: N/A