The recognition that researcher discretion coupled with unconscious biases and motivated reasoning sometimes leads to false findings ("p-hacking") led to the broad embrace of study preregistration and other open-science practices in experimental research. Paradoxically, the preregistration of quasi-experimental studies remains uncommon…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

Evaluations that combine social science and law have tremendous potential to illuminate the effects of governmental policies and yield insights into how effectively policy makers' efforts achieve their aims. This potential is infrequently achieved, however, because such interdisciplinary research contains often overlooked substantive and…

Describes the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) and reviews and assesses research on its impact. Recommends policy reforms and randomized experiments to evaluate the program and any changes made to it. Weaknesses in research to date make the real impacts of WIC unclear. (Contains 79 references.) (SLD)

In-house evaluators must develop evaluation procedures that accommodate not only their own professional standards but also the problem-solving styles of the organizations they serve. This article describes how a small sample of evaluators have adapted their methods to their contexts. (Author)

This article discusses the use of propensity scoring in experimental program evaluations to estimate impacts for subgroups defined by program features and participants' program experiences. The authors discuss estimation issues and provide specification tests. They also discuss the use of an overlooked data collection design--obtaining predictions…

The Collegiate Learning Assessment (CLA) is a computer administered, open-ended (as opposed to multiple-choice) test of analytic reasoning, critical thinking, problem solving, and written communication skills. Because the CLA has been endorsed by several national higher education commissions, it has come under intense scrutiny by faculty members,…

Criteria for suitable research designs for use with large databases are suggested and analyzed. The advantages and disadvantages of several types of quasi-experimental designs are compared. Examples are taken from the authors' research with data from the Manitoba Health Services Commission. (Author/AL)

A methodology is developed for producing a well-designed problem in policy analysis. This evaluative context methodology is defined as an iterative process based on a series of checklist questions. Use of the methodology is demonstrated in a policy development project in New Zealand devoted to encouraging use of the Maori language. (SLD)