Theories of visual narrative comprehension have advocated for a hierarchical grammar-based comprehension mechanism, but only limited work has investigated this hierarchy. Here, we provide a computational framework inspired by computational psycholinguistics to address hierarchy in visual narratives. The predictions generated by this framework were…

Viewers' attentional selection while looking at scenes is affected by both top-down and bottom-up factors. However, when watching film, viewers typically attend to the movie similarly irrespective of top-down factors--a phenomenon we call the "tyranny of film." A key difference between still pictures and film is that film contains…

This study aims to bridge the research gap in the humour comprehension problems of individuals with dyslexia in Chinese culture. We conducted a nonexperimental study to examine the differences between Chinese adolescents with and without dyslexia in visual humour comprehension as well as the group differences in the correlation of visual humour…

Recent work has investigated the origin of infant colour categories, showing pre-linguistic infants categorise colour even in the absence of colour words. These infant categories are similar but not identical to adult categories, giving rise to an important question about how infant colour perception changes with the learning of colour words. Here…

This experiment employed viewing time methods to investigate the effects of individual differences in visuospatial working memory (VWM) on the processing of older adults' bridging inferences in the understanding of visual narratives. The results showed that older adults could make bridging inferences in visual narrative processing, and that VWM…

Children with autism spectrum disorder (ASD) have deficits in audiovisual speech perception and temporal processing. The current study has examined the relationship between the audiovisual speech perception deficits and temporal processing deficits in children with and without ASD. To this end, using the McGurk paradigm, we implemented two…

The comprehension of signed language requires linguistic and visual-spatial processing, such as perspective-taking for correctly interpreting the layout of a spatial scene. However, little is known about how adult second-language (L2) learners process visual-spatial constructions in a signed language that they are studying, including which angles…

Multi-modal discourse comprehension requires speakers to combine information from speech and gestures. To date, little research has addressed the cognitive resources that underlie these processes. Here we used a dual-task paradigm to test the relative importance of verbal and visuospatial working memory in speech-gesture comprehension. Healthy,…

Visual, as compared to verbal, tasks are often assumed to be easier for individuals with autism spectrum disorder (ASD), but is this true for story comprehension? This study evaluated story comprehension monitoring across visual, listening, and written modalities and assessed predictors in two closely matched groups (age, socioeconomic status,…