This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

When attempting to determine if an intervention has a causal impact, the "gold standard" of program evaluation is the randomized controlled trial (RCT). In education studies random assignment is rarely feasible at the student level, making RCTs harder to conduct. School-level assignment is more common but this often requires considerable resources…

The purpose of this case study was to explore the perceptions and experiences of one class of sixth grade middle students enrolled in a Title I reading class. The class consisted of 15 students. Through instrumental case study, qualitative data were collected over 24 weeks through (a) interviews, (b) observations, and (c) documents: student…

During the 2001-02 academic year, a purposive, national evaluation was undertaken of "Windows on Literacy" and "Reading Expeditions," two new school-based programs produced by the School Publishing Division of the National Geographic Society (NGS). The evaluation sought to determine the efficacy of the new materials for…

This paper focuses on certain technical aspects of reading-program evaluation, noting the differences in decision-making requirements and data-collection procedures between local administrators and State and Federal evaluators. The paper discusses the following differences in decision-making requirements: evaluating groups or individuals,…

Five major steps are involved in evaluating school reading programs: clarifying evaluators' role, data collection, data analysis, data reporting, and followup. This article explains these steps and presents a checklist for guiding the measurement of motivation, clarification, application, and satisfaction components. (MLH)

An overall analysis is made of the impact of Grade 3 Title I reading programs in the State of Michigan. An attempt is made to estimate the effectiveness of particular reading programs for low-scoring, middle-scoring, and high-scoring pupils for the purpose of identifying exemplary programs. In addition, a rank ordering of the various programs…

This paper presents a discussion of several factors which influence evaluation utilization. Its purpose is to propose to Alkin's utilization framework the addition of one factor: multiplexity of data gathering methods. Two distinct discussions comprise this paper. First, supportive arguments for the assumption that this factor substantially…

The evaluation system used by the District of Columbia Public Schools is explained. Information is organized to assess four categories: students; instructional personnel; classroom characteristics; and reading programs. The system is used to provide basic profiles and comparative information for four areas of planning: (1) needs assessment; (2)…

A case study approach was used to evaluate the statewide reading improvement project in Louisiana called Special Plan Upgrading Reading (SPUR). SPUR emphasized a change agent approach by providing Technical Assistants and small stipends (approximately $5,000) to participating school districts. During the first two years of the evaluation,…

The philosophy of the District of Columbia Public School System is that evaluation should help to determine what was intended, what was done, and what was the result. It should contribute to improvement and should involve students, staff, and parents. Two essential components of the District's evaluation system are the data bank and field studies.…