We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

The development of a project to assess the effectiveness of schools in a large urban school district is described in this paper, with a focus on improving the validity of school effectiveness instruments. Purposes of the project were to develop a methodology for reporting effective school strategies and to generate a broader profile of schools'…

After offering some possible explanations for the existing inadequacies in evaluating organizational training programs, the authors discuss several evaluation issues, particularly internal validity. Methods for overcoming evaluation inadequacies and the implications for better controlled evaluation designs are also covered. (EM)

Information on why readership surveys are valuable and on how to conduct them is presented, along with sample surveys used at a number of different institutions, and a questionnaire used by the Council for Advancement and Support of Education to measure the opinion of "CASE CURRENTS," readers. Guidelines for doing a mail survey outline…

The problem of the appropriate comparison group for bereavement studies is discussed. The use of the retrospective pretest design is illustrated through a longitudinal study of bereavement outcome following pregnancy loss, involving 138 bereaved women and a comparison group of 215 currently pregnant women. (SLD)

As a step in combining three of the Elementary and Secondary Education surveys of the National Center for Education Statistics to produce one database linking local education agencies, schools, and teachers, the merged procedures and collections forms were pretested. Different methods were tested by splitting the pretest sample of 220 public…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

Recent research results strongly suggest that the theoretical problems of change measures have limited practical significance for measuring individual growth, and it is important to determine whether this is also the case for measuring school impact. Accordingly, in this study artifical data were used to assess the correlation between several…

The Elementary and Secondary Education Act Title I Evaluation and Reporting System is a method for giving a federally funded project in reading or math an overall score on its cognitive effectiveness. This System introduced the Normal Curve Equivalent (NCE) as an aid in aggregating Title I program scores across states and nationwide regardless of…

An evaluation of the first year of "The Electric Company" is provided. Volume 1 is comprised of the following chapters: I. Introduction; II. Preparing for the Evaluation (Research Design and Sampling Procedures; Field Operations; The Treatment--the in-school viewing treatment, the at-home viewing treatment, and the content of The…