We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

Randomized experiments have long been established as the gold standard for addressing causal questions. However, experiments are not always feasible or desired, so observational methods are also needed. When multiple observations on the same variable are available, a repeated measures design may be used to assess whether a treatment administered…

In the present study, we describe the innovative use of the National Board of Medical Examiners (NBME) Comprehensive Basic Science Examination (CBSE) as a progress test during the preclerkship medical curriculum. The main aim of this study was to provide external validation of internally developed multiple-choice assessments in a new medical…

The purpose of this study was to determine the impact of additional revenues for safe school programs and services on the incidences of violent behaviors in the educational environment of a rural and urban school retrieving data from the fourth and final calculation of the Florida Education Finance Program (FEFP) for the 2001 to 2002, 2002 to…

The purpose of this report was to explicate the use of logistic regression and classification and regression tree (CART) analysis in the development of early warning systems. It was motivated by state education leaders' interest in maintaining high classification accuracy while simultaneously improving practitioner understanding of the rules by…

This report describes the implementation of professional development (PD) reforms and efforts to use teacher effectiveness (TE) data to inform PD through the third year of the initiative for all seven sites: Hillsborough County Public Schools (HCPS), Shelby County Schools (SCS, formerly Memphis City Schools), Pittsburgh Public Schools (PPS), and…

The purpose of this study was to examine potential validity concerns regarding the use of music festival scores as an element of value-added assessment practices mandated by federal education policy. Nonmusical school and band characteristics of band size, school enrollment, school percentage of minority enrollment, and school percentage of…

As state tests of student achievement are used for an increasingly wide array of high- and low-stakes purposes, evaluating their instructional sensitivity is essential. This article uses data from the Bill and Melinda Gates Foundation's Measures of Effective Project to examine the instructional sensitivity of 4 states' mathematics and English…

In a response-to-intervention framework, schools typically employ a direct route approach to screening, in which students identified as at risk by a screening process are directly placed into intervention. Direct route approaches require screening decisions to be highly accurate, but few studies examining the predictive validity of reading…

Correlations and mean score differences between IQs derived from the Universal Nonverbal Intelligence Test (UNIT; Bracken & McCallum, 1998) and the Wechsler Intelligence Scale for Children-Third Edition (WISC-III; Wechsler, 1991) were compared. Participants were Limited English Proficient (LEP) Mexican-American elementary school students, who…

The Commission on International Adult Education (CIAE) of the American Association for Adult and Continuing Education (AAACE) provides a forum for the discussion of international issues related to adult education in general, as well as adult education in various countries around the globe. The following purposes summarize the work of the…