Previous evidence suggests that children's mastery of prosodic modulations to signal the informational status of discourse referents emerges quite late in development. In the present study, we investigate the children's use of head gestures as it compares to prosodic cues to signal a referent as being contrastive relative to a set of possible…

This research investigated whether observing beat gesture and hearing contrastive accenting with novel words enhances their learning in early childhood and whether these effects differ by sex in light of sex differences in the pace of language development. Fifty-three 3- to 5-year-old boys and girls learned pairs of novel words with contrasting…

This article reviews research findings involving visual input in speech processing in the form of facial cues and co-speech gestures for second-language (L2) learners, and provides pedagogical implications for the teaching of listening and speaking. It traces the foundations of auditory-visual speech research and explores the role of a speaker's…

Visual cues may help second language (L2) speakers perceive interactional feedback and reformulate their nontarget forms, particularly when paired with recasts, as recasts can be difficult to perceive as corrective. This study explores whether recasts have a visual signature and whether raters can perceive a recast's corrective function.…

Children achieve their first language milestones initially in gesture and prosody before they do so in speech. However, little is known about the potential precursor role of those features later in development when children start using more complex linguistic skills. In this study, we explore how children's ability to reflect on their degree of…

This article investigates how children leverage intonational and gestural cues to an individual's belief state through unimodal (intonation-only or facial gesture-only) and multimodal (intonation + facial gesture) cues. A total of 187 preschoolers (ages 3-5) participated in a disbelief comprehension task and were assessed for Theory of Mind (ToM)…

It is yet unclear whether congenitally deaf cochlear implant (CD CI) users' visual and multisensory emotion perception is influenced by their history in sign language acquisition. We hypothesized that early-signing CD CI users, relative to late-signing CD CI users and hearing, non-signing controls, show better facial expression recognition and…

This study investigates the perception and production of a specific type of metaphoric gesture that mimics melody in speech, also called "pitch gesture," in the learning of L2 suprasegmental features. In a between-subjects design, a total of 106 participants with no previous knowledge of Chinese were asked to observe (Experiment 1) and…

Using a novel emotional perspective-taking task, this study investigated 4-year-olds' (n = 97) use of a speaker's emotional prosody to make inferences about the speaker's emotional state and, correspondingly, their communicative intent. Eye gaze measures indicated preschoolers used emotional perspective inferences to guide their real-time…

This study investigates 3- to 5-year-old children's sensitivity to lexical, intonational and gestural information in the comprehension of speaker uncertainty. Most previous studies on children's understanding of speaker certainty and uncertainty across languages have focused on the comprehension of lexical markers, and little is known about the…

The ability to infer the emotional states of others is central to our everyday interactions. These inferences can be drawn from several different sources of information occurring simultaneously in the communication situation. Based on previous studies revealing that children pay more heed to situational context than to emotional prosody when…

This dissertation is an investigation of acoustic properties of lexical tone in two dialects of Dane-zaa (Athabaskan). The noteworthy mirror-image tone systems of the H-marked Doig and L-marked Halfway dialects provide a unique opportunity to explore intrinsic differences in how pitch manifests in specific environments. The dissertation has three…

Children with limited language expression and comprehension abilities are at risk for academic failure, particularly in literacy acquisition. In addition, these children often have poor social outcomes, including difficulty forming friendships, social exclusion, withdrawal, and victimization. The academic and social difficulties that these…

The training of tactical decision making increasingly occurs through serious computer games. A challenging aspect of designing such games is the modelling of human emotions. Two studies were performed to investigate the relation between fidelity and human emotion recognition in virtual human characters. Study 1 compared five versions of a virtual…

This dissertation investigated the effects of technological mediation on second language (L2) learning, focusing, as a case study, on gains in listening perception of the subtle but important feature of pitch placement in Japanese. Pitch accent can be difficult to perceive for non-native speakers whose first language (L1) does not rely on pitch or…