The Assessment of Afterschool Program Practices Tool ("APT"), developed by the National Institute of Out-of-School Time (NIOST), is an observational instrument designed to measure the aspects of afterschool program quality that research suggests contribute to the 21st century skills, attitudes, and behaviors youth need to be successful…

Despite a significant body of work that documents the importance of mother-child relationships, the studies on programmes that support these relationships are few, particularly with respect to subclinical populations. In this report, we coded the responses of 114 mothers of infants and toddlers to open-ended questions in order to identify the…

Reading texts with historical and sociopolitical content in a foreign language is often a challenge for second language students. The obstacles encountered by students should be of concern to language instructors. Lack of background knowledge frequently causes the reader to abandon the reading activity with a sense of disappointment and…

The author's community, which includes parents of the 62,000 students who attend schools in Volusia County, Florida, has been baffled over the conflicting nature of Florida's school grading system of A, B, C, D, F based on the Florida Comprehensive Assessment Test, and the federal system of pass or fail. While many of the 80 schools in her…

The Autism Mental Status Examination (AMSE) described here is an eight-item observational assessment that prompts the observation and recording of signs and symptoms of autism spectrum disorders (ASD). The AMSE is intended to take place seamlessly in the context of a clinical exam and produces a total score. Subjects were independently…

The present study investigated the impact of an antecedent intervention in the form of a daily posted schedule on the interobserver agreement (IOA) assessment of educational goals implemented within a classroom at a private school serving individuals with disabilities. During baseline, the percentage of academic goals with interobserver agreement…

We evaluated interrater agreement across multiple respondents on anecdotal assessments and compared cases in which agreement was obtained with outcomes of functional analyses. Experiment 1 evaluated agreement among multiple respondents on the function of problem behavior for 27 individuals across 42 target behaviors using the Motivation Assessment…

A comparison between six rater agreement measures obtained using three different approaches was achieved by means of a simulation study. Rater coefficients suggested by Bennet's [sigma] (1954), Scott's [pi] (1955), Cohen's [kappa] (1960) and Gwet's [gamma] (2008) were selected to represent the classical, descriptive approach, [alpha] agreement…

An important part of test development is ensuring alignment between test forms and content standards. One common way of measuring alignment is the Webb (1997, 2007) alignment procedure. This article investigates (a) how well item writers understand components of the definition of Depth of Knowledge (DOK) from the Webb alignment procedure and (b)…

Despite the desire of employers to hire those with the critical-thinking and communication skills a general education (GE) program can offer, the value of GE programs is often questioned due to concerns about four-year graduation rates, perceived low immediate economic payoff, and a dearth of evidence to support their efficacy. This article…

Human raters are normally involved in L2 performance assessment; as a result, rater behavior has been widely investigated to reduce rater effects on test scores and to provide validity arguments. Yet raters' cognition and use of rubrics in their actual rating have rarely been explored qualitatively in L2 speaking assessments. In this study three…

Although several different reading fluency intervention approaches appear promising for adolescents who are struggling readers, few studies have directly compared various approaches. The purpose of this study was twofold: 1) to determine the relative effects of word-oriented, fluency-oriented, comprehension-oriented, and multi-component…

Introduction: The Multiple Mini-Interview (MMI) format appears to mitigate individual rater biases. However, the format itself may introduce structural systematic bias, favoring extroverted personality types. This study aimed to gain a better understanding of these biases from the perspective of the interviewer. Methods: A sample of MMI…

The purpose of this exploratory study was to identify, categorize, and describe practitioners' perspectives regarding factors that help and hinder sustainability of Tier I (universal) systems within School-wide Positive Behavioral Interventions and Supports (SWPBIS). Seventeen participants involved in sustaining Tier I SWPBIS over several years…

The purpose of this study was to assess the effects of cover, copy, and compare (CCC) on the spelling performance of three male middle school students. Two of the participants had learning disabilities and the third was health impaired. The study was conducted in a public school resource room in the Pacific Northwest. A multiple-baseline across…