Objectives: The aim of this pilot study was to explore psychometric properties of two versions of the Home Observation for Measurement of the Environment Inventory in a Swedish social service sample. Method: Social workers employed at 22 Swedish child protections agencies participated in the data collection. Both classic test theory approaches and…

A significant number of young children exhibit challenging behaviors in preschool settings. A tiered framework of intervention has documented effectiveness in elementary and secondary schools, and recently has been extended to preschool settings. Although there is emerging research to support the effectiveness of Tier 1 (universal) and Tier 3…

Work integrated learning (WIL) educators using reflective practice to facilitate student learning require a set of standards that works within the traditional assessment frame of Higher Education, to ascertain the level at which reflective practice has been demonstrated. However, there is a paucity of tested assessment instruments that provide…

Assessment is the foundation for conceptualizing effective interventions. Due to their nonverbal nature, art therapy assessments have an advantage over traditional verbal assessments in some populations and potentially across cultures. This pilot study provides preliminary reliability data to support the cross-cultural use of the Formal Elements…

Most investigators using single-case experimental designs use interobserver agreement (IOA) checks to enhance the credibility of the collected data, and they report the results of those assessments using percentage of agreement estimates. An alternative is to graph both observers' records of the measured behavior on the primary study graphs. Such…

The purpose of this study was to investigate the intra-rater and inter-rater reliability of the Critical Thinking Analytic Rubric (CTAR). The CTAR is composed of 6 rubric categories: interpretation, analysis, evaluation, inference, explanation, and disposition. To investigate inter-rater reliability, two trained raters scored four sets of…

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Children who have difficulty learning to read are at increased risk for academic failure, poor self-esteem, anxiety and depression, and unemployment. To help reduce these risks, it is important to identify and treat weaknesses in a child's reading as early as possible. The aim of this study was to develop a valid and reliable comprehensive…

The present pilot study investigated the impact of video hero modelling (VHM) on the daily living skills of an elementary-aged student with autism spectrum disorder. The VHM, in which a character much admired by the student exhibited a correct response, was shown to the participant immediately before the situation where he needed to exhibit the…

As the pivotal role of self-regulation has been widely accepted in online learning literature, much interest is focused on identifying pedagogical strategies to help foster regulatory behaviors in online learners. The authors of this article argue that the learning presence (LP) construct, a recently proposed addition to the Community of Inquiry…

Student self-assessment has been heralded as a way of increasing student ownership of the learning process, enhancing metacognative awareness of their learning progress as well as promoting learner autonomy. In a university setting, where a major aim is to promote critical thinking and attentiveness to one's responsibility in an academic…

Background: Children's low scores on vocabulary tests are often erroneously interpreted as reflecting poor cognitive and/or language skills. It may be necessary to incorporate the measurement of word-learning ability in estimating children's lexical abilities. Aims: To explore the reliability and validity of the Dynamic Assessment of…

The purpose of this study was to rate oral retellings of fifth graders to determine how passages, raters, and rating occasions affect those ratings, and to identify what combination of those elements produce reliable retelling ratings. A group of 36 fifth grade students read and orally retold three contemporary realistic fiction passages. Two…

For a number of reasons, increasing reliance is being placed on teacher assessment in high-stakes contexts in many countries around the world. Simultaneously, countries that have for some time relied to greater or lesser degrees on teacher assessment for high-stakes purposes are in the process of questioning the validity of that reliance. In…

The purpose of this study was to explore the effect of instrument-specific rater training on interrater reliability (IRR) and counseling skills performance differentiation. Strong IRR is of primary concern to effective program evaluation (McCullough, Kuhn, Andrews, Valen, Hatch, & Osimo, 2003; Schanche, Nielsen, McCullough, Valen, &…