The assessment of English speaking in EFL environments can be inherently subjective and influenced by various factors beyond linguistic ability, including choice of assessment criteria, and even the rubric type. In classroom assessment, the type of rubric recommended for English speaking tasks is the analytical rubric. Driven by three aims, this…

This study aims to explore the validity of measuring joint attention through gaze coordination in computer-supported collaborative learning (CSCL) research. Gaze coordination, aligning visual attention in social contexts, aids comprehension and communication. Many CSCL researchers use gaze coordination to gauge joint attention quantitatively.…

The goal of this paper is twofold. First, the paper clarifies and elaborates on an important theoretical construct called orientation with respect to understanding in mathematics, which denotes the degree to which students exhibit an inclination towards and demonstrate an earnest concern for understanding in mathematical learning. Second, the…

Purpose: The aim of this study is to measure the concurrent validity of the Athletic Skills Track (AST) by examining whether its outcome score correlates with the holistic judgments of experts about the quality of movement. Method: Video recordings of children performing the AST were shown to physical education teachers who independently gave a…

Tools to assess the dispositions of counselor education applicants at the point of program admission are important as mechanisms to screen entrance into the profession. The authors developed the Professional Disposition Competence Assessment-Revised Admission (PDCA-RA) as a screening tool for dispositional assessment in admissions interviews. In…

One of the most important considerations in designing clinical infant research studies is the selection of reliable and valid measurement procedures. Few measures of caregiver-child interactions have been studied with newborns, particularly premature infants. The main objective of this study was to examine psychometric properties of the National…

We compared systematically the structure, the focus, the thematic sequences, the complexity and the syntactic properties between maternal and paternal infant-directed speech in engagements of infants with their mothers and fathers. Eleven mother-infant and 11 father-infant dyads were video-recorded during their natural interactions at home from…

In this study, we explored the potential for machine scoring of short written responses to the Classroom-Video-Analysis (CVA) assessment, which is designed to measure teachers' usable mathematics teaching knowledge. We created naïve Bayes classifiers for CVA scales assessing three different topic areas and compared computer-generated scores to…

Teacher observations have become a national education phenomenon, mandated by federal policies and promoted by philanthropists. They are crucial components of teacher evaluation systems that often have high stakes for teachers and school systems, but have sparked little innovation. Recent calls to make teacher evaluations better, faster, and…

Examination of infant vocalization patterns across interactive and noninteractive contexts may facilitate better understanding of early communication development. In the current study, with 24 infant-parent dyads, infant volubility increased significantly when parent interaction ceased (presenting a "still face," or SF) after a period of…

This study examined the reliability and validity of the Classroom Assessment Scoring System-Secondary (CLASS-S) in Finnish classrooms. Trained observers coded classroom interactions based on video recordings of 46 Grade 6 classrooms (450 cycles). Concurrent associations were investigated with respect to teacher self-ratings (e.g., efficacy beliefs…

This article investigates the link between teachers' appraisal of specific interpersonal situations in classrooms and their more general interpersonal identity standard, which together form their interpersonal role identity. Using semi-structured and video-stimulated interviews, data on teachers' appraisals and interpersonal identity standards…

This study investigated questions adults asked to children with autism spectrum disorder in inclusive pre-kindergarten classrooms, and whether child (e.g. autism severity) and setting (i.e. adult-to-child ratio) characteristics were related to questions asked during center-time. Videos of verbal children with autism spectrum disorder (n?=?42) were…

Introduction: Observational research using the thin slice technique has been routinely incorporated in observational research methods, however there is limited evidence supporting use of this technique compared to full interaction coding. The purpose of this study was to determine if this technique could be reliability coded, if ratings are…

As states, districts, and schools transition toward more rigorous educator evaluation systems, they are placing additional weight on judgments about educator practice. Since teacher and principal observation ratings inherently rely on evaluators' professional judgment, there is always a question of how much the ratings depend on the particular…