The Canadian Agility and Movement Skill Assessment (CAMSA) is a valid and reliable circuit-based test of motor competence which can be used to assess children's skills in a live or recorded performance and then coded. We aimed to analyze the intrarater reliability of the CAMSA scores (total, time, and skill score) and time measured, by comparing…

Thin slices ratings (i.e., ratings based on first impressions) have yielded intriguingly accurate results in various domains. Among other, researcher have applied the thin slices technique to assess instructional quality, showing that teacher-student interactions can be reliably inferred by just very short snippets of classroom instruction. The…

Background: Pretend play is a form of play that involves nonliteral actions. There are limited studies reporting the developmental trends of pretend play behaviours of typically developing pre-schoolers. This knowledge would be beneficial in the early identification of deviations in pre-schoolers who have or are at risk of developing developmental…

This paper presents the voice emotion recognition part of the FILTWAM framework for real-time emotion recognition in affective e-learning settings. FILTWAM (Framework for Improving Learning Through Webcams And Microphones) intends to offer timely and appropriate online feedback based upon learner's vocal intonations and facial expressions in order…

Although interview formats support rich data collection in conceptual change studies, interview formats limit sample sizes. This study explores the possibility of using constructed-response formats as an alternative or supplement for collecting similarly rich data across larger pools of subjects in conceptual change studies. While research in…

Teacher observation remains one of the primary data collection methods for analyzing teaching behaviors. States use various evaluation instruments and current trends across the United States show that more states are working to tie teacher evaluation to student performance. The purpose of this study was to determine to what extent there was…

The objective of this study was to develop an instrument to observe the play behaviour of a whole group of children from four to six years of age in a classroom setting on the basis of video recording. The instrument was developed in collaboration with experienced teachers and experts on play. Categories of play were derived from the literature…

Despite considerable interest in the topic of instructional quality in research as well as practice, little is known about the quality of its assessment. Using generalizability analysis as well as content analysis, the present study investigates how reliably and validly instructional quality is measured by observer ratings. Twelve trained raters…

Objective: Although health professionals increasingly are expected to be able to assess and manage patients' risk for suicide, few methods are available to evaluate this competency. This report describes development of a competency-assessment instrument for suicide risk-assessment (CAI-S), and evaluates its use in an objective structured clinical…

The teaching of imitation skills is often the first step in interventions for young learners with intellectual disabilities. The main goal of this study was to determine the smallest detectable difference (SDD) at 95% confidence of the Preschool Imitation and Praxis Scale (PIPS) in preschoolers with intellectual disabilities. Two raters…

In the complex practice of today's blended learning, educators need to be able to evaluate both online and face-to-face communication in order to get the full picture of what is going on in blended learning scenarios. The aim of this study was to investigate the reliability and feasibility of a practical instrument for analysing face-to-face…

This study reports on the development and usefulness of an assessment procedure for teachers' coaching competence. We examined the usefulness of the developed procedure with respect to making reliable judgments. Video portfolios were constructed by researchers, which consisted of deliberately planned video recordings of teachers' coaching…

We assessed the reliability and validity of the discrete-trials teaching evaluation form (DTTEF), a 21-item checklist for assessing instructors conducting discrete-trials teaching (DTT). In Phase 1, six consultants in an applied behavior analysis program for children with autism rated the 21 components of the DTTEF with a mean of 6.2 on a 7-point…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

Educators must often decide how many points to use in a rating scale. No studies have compared interrater reliability for different-length scales, and few have evaluated accuracy. This study sought to evaluate the interrater reliability and accuracy of mini-clinical evaluation exercise (mini-CEX) scores, comparing the traditional mini-CEX…