School playgrounds offer ample opportunity to observe the unstructured free-play of school-aged children; however, obtaining valid observations can be difficult to accomplish. Recent technological advances in commercially available aerial drones have the potential to contribute to behavior observation work conducted on playground settings. This…

As a result of the COVID-19 pandemic, many instructors were forced to adjust from in-person to emergency remote teaching; however, classroom observation protocols, like the Classroom Observation Protocol for Undergraduate STEM (COPUS), have only been developed and validated for in-person instruction. Therefore, we developed and validated an…

As states consider non-academic measures of school quality for their accountability plans under the Every Student Succeeds Act, few are choosing to focus on the school climate in which students learn. That's not a surprise, given concerns about the validity and usefulness of existing climate surveys. However, the authors argue, a recent study…

The number of articles showing dissatisfaction with the null hypothesis statistical testing (NHST) framework has been progressively increasing over the years. Alternatives to NHST have been proposed and the Bayesian approach seems to have achieved the highest amount of visibility. In this last part of the special issue, a few alternative…

Recent literature places more emphasis on assessment comments rather than relying solely on scores. Both are variable, however, emanating from assessment judgements. One established source of variability is "contrast effects": scores are shifted away from the depicted level of competence in a preceding encounter. The shift could arise…

Range restrictions, or raters' tendency to limit their ratings to a subset of available rating scale categories, are well documented in large-scale teacher evaluation systems based on principal observations. When these restrictions occur, the ratings observed during operational teacher evaluations are limited to a subset of the available…

Classroom management practices are critical to the success of teachers and students, and a growing number of programs have been developed to improve these practices. However, there has been less investigation into observational tools to assess classroom management and exploration of whether it can be measured consistently by observers across…

The increasing use of direct observation tools to assess routine performance has resulted in the growing reliance on assessor-based judgements in the workplace. However, we have a limited understanding of how assessors make judgements and formulate ratings in real world contexts. The current research on assessor cognition has largely focused on…

Background: Individuals with intellectual disability experience the same chronic diseases and conditions as the general population, but are more likely to have physical and psychological co-morbidities, resulting in a higher risk of experiencing pain and having more frequent or severe pain. Method: This position paper aims to highlight the…

Adolescents experiencing social anxiety often engage in safety behaviors--covert avoidance strategies for managing distress (e.g., avoiding eye contact)--that factor into the development and maintenance of their concerns. Prior work supports the psychometric properties of the Subtle Avoidance Frequency Examination (SAFE), a self-report survey of…

The terms "outcome" and "impact" are ubiquitous in evaluation discourse. However, there are many competing definitions that lack clarity and consistency and sometimes represent fundamentally different meanings. This leads to profound confusion, undermines efforts to improve learning and accountability, and represents a…

Despite growing interest in formative assessment of teacher practices, research on rates of change in teachers' practices is sparse. This is the first study to examine the characteristics of observed change in classroom practices using the Classroom Strategies Assessment System (CSAS) across alternative schedules of data collection during…

Vocational education aims at preparing students for their future as professionals; thus, students are often required to undergo a form of on-the-job learning. Assessment of professional performance during on-the-job learning is not based on single observations, but on prolonged participation at the workplace culminating in judgement by a workplace…

In order to achieve the goal of observation, preparation of the adult, the observer, is necessary. This preparation, says Hilla Patell, requires us to "have an appreciation of the significance of the child's spontaneous activities and a more thorough understanding of the child's needs." She discusses the growth of both the desire to…

This study describes the development and initial psychometric evaluation of the Recognizing Effective Special Education Teachers (RESET) observation instrument. The study uses generalizability theory to compare two versions of a rubric, one with general descriptors of performance levels and one with item-specific descriptors of performance levels,…