We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

The purpose of the present study was to examine a common practice in some areas of program evaluation, the retrospective pretest, and to present recommendations regarding its use. The authors review literature to emphasize first, that bias is likely in both prospective and retrospective ratings, and second, that under some circumstances,…

The Program Standards Evaluation System was developed in response to evaluation requirements in the 1973 Rehabilitation Act. The system includes procedures for using standards data to monitor and evaluate vocational rehabilitation (VR) service outcomes and outputs as well as standards on key procedural issues. The system includes procedures for…

Separate selection and pretesting of students eliminate regression effects in the pre-post achievement gain measured in the RMC Model--A method of program evaluation. (CP)

After offering some possible explanations for the existing inadequacies in evaluating organizational training programs, the authors discuss several evaluation issues, particularly internal validity. Methods for overcoming evaluation inadequacies and the implications for better controlled evaluation designs are also covered. (EM)

The Adult Education Outreach Program in Monangalia County was designed to meet an apparent need and assess the feasibility of developing similar programs in other areas of West Virginia. Goals and assessment of success were based on these four research questions: (1) Will adults who need skills in solving consumer problems avail themselves of the…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

An overall analysis is made of the impact of Grade 3 Title I reading programs in the State of Michigan. An attempt is made to estimate the effectiveness of particular reading programs for low-scoring, middle-scoring, and high-scoring pupils for the purpose of identifying exemplary programs. In addition, a rank ordering of the various programs…

The accuracy with which regression models estimate treatment effects is dependent upon a number of conditions. The stability of the regression line (a function of sample size and correlation between pretest and posttest) is said to be the most important of these conditions. The utility of regression models is proportional to the size of the…

To determine the long-run impact of the CERLI training program, the trainees' abilities to function as Specialists in Continuing Education (SCE) had to be measured and assessed. This assessment is a followup to "Assessment of the CERLI Training Program Specialist in Continuing Education" (EA 002 706). The document reports on attempts to…

Recent research results strongly suggest that the theoretical problems of change measures have limited practical significance for measuring individual growth, and it is important to determine whether this is also the case for measuring school impact. Accordingly, in this study artifical data were used to assess the correlation between several…

To investigate the assertion that there is a tendency for teachers to emphasize skills already mastered by their students, data were collected on 488 seventh grade mathematics students in three junior high schools. Of these, 285 were assigned to experimental classes taking the curriculum under development and 203 were assigned to comparison…

This paper presents the designs underlying an IPI approach to ninth grade science implemented in the Jamesville-DeWitt schools in New York State. Briefly described are the generalizable instructional model, evaluation systems for assessing individual performance and the effectiveness of the instructional program and the support systems which make…

A criterion-referenced instrument, Inventory of Cognitive Skills and Visual-Motor Functioning, was devised to evaluate a prekindergarten program for economically disadvantaged 4-year-olds. The Inventory, administered to each child at the beginning and end of the preschool experience, provided specific information in: (1) knowledge of body parts,…

The Elementary and Secondary Education Act Title I Evaluation and Reporting System is a method for giving a federally funded project in reading or math an overall score on its cognitive effectiveness. This System introduced the Normal Curve Equivalent (NCE) as an aid in aggregating Title I program scores across states and nationwide regardless of…