This article offers a multimodal analysis of spontaneous, improvisatory interactions between pre-service teachers as they engage with a range of material resources connected to, or generated by, a literary text (in this case, the Old English poem Beowulf). We draw on an understanding of role as a form of frame, offering students a particular…

Facial expressions provide key information for successful social interactions. Recent research finds that accurate perception of emotion expressions decreases when faces are presented with face masks. What is unknown is how individual differences in social intelligence may influence perception of masked emotion expressions. In this study,…

A common problem in video conferences is gaze direction. In face-to-face communication, it is common that speaker and listener intermittently look at each other. In a video-conference setting, where multiple participants are on the screen, things are complicated and not necessarily optimal. If the listener feels looked at when the speaker looks…

We hypothesized that autistic adults may be erroneously judged as deceptive or lacking credibility due to demonstrating unexpected and atypical behaviors. Thirty autistic and 29 neurotypical individuals participated in video-recorded interviews, and we measured their demonstration of gaze aversion, repetitive body movements, literal interpretation…

Research has shown that gesture production supports learning across a number of tasks. It is unclear, however, whether gesture production during encoding can support narrative recall, who gesture production benefits most, and whether certain types of gestures are more beneficial than others. This study, therefore, investigated the effect of…

In everyday interaction interlocutors use pragmatic co-speech gestures to cooperatively construct conversation. Shrugs, one of the most common pragmatic gestures, communicate a remarkable array of seemingly unrelated or even contradictory meanings--agreement and disagreement, ignorance and obviousness, interest and disinterest, among others.…

This full paper concerns the use of gesture analysis to guide instructional approaches in engineering education. Engineering is rife with abstract mathematics and processes for quantifying physical phenomena. In engineering instruction, "formalisms first" is a practice that privileges formalisms over grounded and applied ways of knowing…

Autism spectrum disorder (ASD) and schizophrenia spectrum disorders (SZ) are characterized by difficulty with social cognition and atypical reception of facial communication - a key area in the Research Domain Criteria framework. To identify areas of overlap and dissociation between ASD and SZ, we review studies of event-related potentials (ERP)…

While observing gesture has been shown to benefit narrative recall and learning, research has yet to show whether gestures that provide information that is missing from speech benefit narrative recall. This study explored whether observing gestures that relay the same information as speech and gestures that provide information missing from speech…

Affect-biased attention is an important predictive factor of children's early socio-emotional development, possibly shaped by the family environment. Our study aimed to reveal children's temporal dynamic patterns of affect-biased attention by looking at time series of attention to emotional faces, individual differences in temporal dynamics, and…

Although the utilization of mobile technologies has recently emerged in various educational settings, limited research has focused on cognitive load detection in the pen-based learning process. This research conducted two experimental studies to investigate what and how multimodal data can be used to measure and classify learners' real-time…

Background: Parkinson's disease (PD) can affect social interaction and communication as well as motor and cognitive processes. Speech is affected in PD, as is the control of voluntary eye movements which are thought to play an important role in 'turn taking' in conversation. Aims: This study aimed to measure eye movements during spoken…

The present study aimed to investigate whether preschoolers can recognise the emotions conveyed in panels of the Asterix comic series. The sample consisted of 40 pre-school children (22 boys and 18 girls), aged 52-72 months. They were presented with 8 panels, which in pairs conveyed the emotions of happiness, sadness, fear and anger. Adult raters…

Developmental difference is a common characteristic of autism spectrum disorder (ASD) with unclear sex differences. The current study included 610 children with ASD, aged between 2 and 7 years, with completed language profiles. We used a nonparametric item response theory model called Mokken scale analysis to examine the order of acquisition of…

Most internationally recognized instruments for the screening and diagnosis of autism spectrum disorder have been developed in the USA, which calls into question the degree of their cultural adaptation to diverse populations. The aim of this study is to examine the characteristics of social communication in typically developing Croatian-speaking…