We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

Describes procedure to measure a new course's ability to meet standards in three areas: student acceptance, student gains, and student comprehension. It has been used over three years to test the acceptability of 31 courses which contain more than 200 videotape presentations, and thousands of pages of print materials. (Author/JEG)

Provides study skills, reading efficiency, and reading effectiveness tests designed to show the student that his reading is actually improving. (RW)

A statistical method, Fishers Table of t (or t ratio), is used to determine the statistical significance of a comparison of results from pretests and post-tests of knowledge and skill taken by training program participants. A statistically significant improvement can demonstrate training effectiveness. (MS)

Historical regression uses the assumption that without intervention, growth at post-test will proceed at the same rate as at pre-test. Several methods of historical regression are compared with an illustrative example. (JKS)

The biasing effects of a pretest on subsequent post-test results were investigated in two experimental studies. In general, the results argue for using designs without pretests. (Author/JKS)

The Adult Education Outreach Program in Monangalia County was designed to meet an apparent need and assess the feasibility of developing similar programs in other areas of West Virginia. Goals and assessment of success were based on these four research questions: (1) Will adults who need skills in solving consumer problems avail themselves of the…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

An overall analysis is made of the impact of Grade 3 Title I reading programs in the State of Michigan. An attempt is made to estimate the effectiveness of particular reading programs for low-scoring, middle-scoring, and high-scoring pupils for the purpose of identifying exemplary programs. In addition, a rank ordering of the various programs…

The accuracy with which regression models estimate treatment effects is dependent upon a number of conditions. The stability of the regression line (a function of sample size and correlation between pretest and posttest) is said to be the most important of these conditions. The utility of regression models is proportional to the size of the…

Two types of sensitivity indices were developed in this paper, one internal to the total test and the second external. To evaluate the success of these statistics the three criteria suggested for a satisfactory index of item quality were considered. The Internal Sensitivity Index appears to meet these demands. Certainly it is easily computed. In…

To determine the long-run impact of the CERLI training program, the trainees' abilities to function as Specialists in Continuing Education (SCE) had to be measured and assessed. This assessment is a followup to "Assessment of the CERLI Training Program Specialist in Continuing Education" (EA 002 706). The document reports on attempts to…

The development of a single value revision indicator which would utilize learner performance data obtained from a pretest-posttest design to rank a set of instructional modules as to their relative need for revision is discussed. A set of procedures was developed in connection with the implementation of the Production, Implementation, Evaluation,…

Problems which should be considered in relation to performance contracting include: legal problems, time for planning, teachers' objections, and measuremet problems. Advantages include: the learning experience of planning, Hawthorne effect excitement, and the low cost of this experimentation. (MS)

The model developed by the Computer Based Project for the Evaluation of Media for the Handicapped in Syracuse, New York to evaluate the use of captioned films for the deaf with mentally handicapped and emotionally disturbed children is briefly described, followed by a review of recent research conducted by the project staff. Among the areas which…