Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

Suppose an education researcher wants to test the impact of a high school drop-out prevention intervention in which at-risk students attend classes to receive intensive summer school instruction. The district will allow the researcher to randomly assign students to the treatment classes or to the control group. Half of the students (the treatment…

The U.S. Department of Education (ED) expects all Teacher Incentive Fund (TIF) grantees to conduct an evaluation of their programs. Experience with earlier rounds of TIF grants has shown that evaluations can provide valuable information for managing and improving TIF-supported activities, as well as evidence that these activities have had a…

This document provides guidance about how to describe studies and report their findings in a way that is clear, complete, and transparent. This document does not include information about how studies are judged against What Works Clearinghouse evidence standards. For information about What Works Clearinghouse evidence standards, please refer to…

The Peer Assisted Learning (PAL) program at the University of Minnesota is a primary academic support program for historically difficult, introductory college courses that serve as gatekeepers to academic degree programs. This document is the training manual used for the new PAL facilitators that manage the small study groups. Based upon operating…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

This is a book about quality and how to control quality through deliberate actions on the part of the professionals developing and implementing the instances of instruction available at an organization. Quality control theory favors no particular learning philosophy and is only directed towards aspects of how, what, where and when measurements are…

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

This guide is designed to help educators plan and carry out evaluations of adult education programs. Following an introduction, Section 2 discusses how the evaluation process fits into the concept and normal cycle of program development. Section 3 describes the stages of the evaluation process, including needs assessment, program planning, process…

Presents methods for assessing the impact and economic viability of federal equal-educational-opportunity programs, particularly in higher education. Techniques for gathering needed data and analyzing them are offered in the context of a hypothetical community college Veterans Upward Bound (VUB) program and two real VUB programs. (MSE)

When studying different types of returns to education, educational reforms are commonly used in the economics literature as a source of exogenous variation in education. The Swedish compulsory school reform is one example; the reform extended compulsory education throughout the country, in different municipalities at different points in time. Such…

The Bilingual Education Evaluation System was developed to help local bilingual education projects overcome evaluation obstacles and design sound, useful evaluations within the constraints of available funding and with responsiveness to current federal legislation and regulations. The evaluation system proposed involves a process component, an…