We examined how movement impacted listeners' perceptions of choral performances. Participants (N = 115; n = 60 nonmusic majors, n = 55 music majors) viewed excerpts of Moses Hogan's "Didn't My Lord Deliver Daniel" under four conditions: good tone/expressive movement (GT/EM), good tone/static movement (GT/SM), poor tone/expressive…

Purpose: This study aimed to analyze audiovisual speech perception strategies in children with dyslexia, specifically addressing difficulties in phonological processing and reading. Our objective was to investigate the impact of different training programs (phonetic and visual) on learning and assess individual differences in strategy preferences…

The process of spoken word recognition is influenced by both bottom-up sensory information and top-down cognitive information. These cues are used to process the phonological and semantic representations of speech. Several studies have used EEG/ERPs to study the neural mechanisms of children's spoken word recognition, but less is known about the…

Emotional competence (EC) refers to a set of skills to identify, understand, and respond to one's own emotions and those of others. It plays a fundamental role in socialization processes, where children with autism spectrum disorders (ASD) and specific language impairment (SLI) show marked deficits. However, due to the similarities between these…

Auditory speech appears to be linked to visual articulatory gestures and orthography through different mechanisms. Yet, both types of visual information have a strong influence on speech processing. The present study directly compared their contributions to speech processing using a novel word learning paradigm. Native speakers of French, who were…

Using a referent detection paradigm, we examined whether listeners can determine the object speakers are referring to by using the temporal alignment between the motion speakers impose on objects and their labeling utterances. Stimuli were created by videotaping speakers labeling a novel creature. Without being explicitly instructed to do so,…

Audiovisual speech consists of overlapping and invariant patterns of dynamic acoustic and optic articulatory information. Research has shown that infants can perceive a variety of basic auditory-visual (A-V) relations but no studies have investigated whether and when infants begin to perceive higher order A-V relations inherent in speech. Here, we…

Pervasive developmental disorder not otherwise specified (PDD-NOS) represents up to two-thirds of autism spectrum disorders; however, it is usually described in terms of the symptoms not shared by autism. The study explores processing of neutral and emotional human stimuli (by auditory, visual and multimodal channels) in children with PDD-NOS (n =…

The ability to predict the effects of actions is necessary to behave properly in our physical and social world. Here, we describe how the ability to predict the consequence of complex gestures can change the way we integrate sight and sound when relevant visual information is missing. Six drummers and six novices were asked to judge audiovisual…

Curriculum guidelines, including the emergent Australian curriculum (Australian Curriculum, Assessment and Reporting Authority [ACARA], 2009-10), indicate expectations that teachers will support their students' interpretation and creation of multimodal texts. However, English curriculum guidelines are yet to advise on a detailed metalanguage to…

Persons with traumatic brain injury (TBI) often have difficulty recognizing emotion in others. This is likely due to difficulties in interpreting non-verbal cues of affect. Although deficits in interpreting facial cues of affect are being widely explored, interpretation of vocal cues of affect has received much less attention. Accurate…

The experiment reported in this article investigated the assumption that visual movement plays a role in musician-to-audience communication in marimba performance. Body movement is of particular relevance here as the expressive capabilities of the marimba are relatively restricted, and the movements required to play it are visible. Twenty-four…

This study examined the ability of young children with autism spectrum disorders (ASD) to detect affective correspondences between facial and vocal expressions of emotion using an intermodal matching paradigm. Four-year-old children with ASD (n = 18) and their age-matched normally developing peers (n = 18) were presented pairs of videotaped facial…

A minimally verbal child with autism was exposed to short daily sessions of watching his parents on video in conjunction with an FM auditory trainer for a period of 4 weeks. Baseline measures of verbal and social behaviors were taken pre-treatment and repeated post treatment. Results indicate substantial gains in word productions, social…

Speakers employ acoustic cues (pitch accents) to indicate that a word is important, but may also use visual cues (beat gestures, head nods, eyebrow movements) for this purpose. Even though these acoustic and visual cues are related, the exact nature of this relationship is far from well understood. We investigate whether producing a visual beat…