A recent paper uses Bayes factors to argue a large minority of rigorous, large-scale education RCTs are "uninformative." The definition of "uninformative" depends on the authors' hypothesis choices for calculating Bayes factors. These arguably overadjust for effect size inflation and involve a fixed prior distribution,…

The Multiattribute Utility Model combines subjective goal definition with objective data analysis. Goals are defined, ranked, and weighted. Subjective opinions about their attainment are assigned against decision alternatives considered by the school. Bayesian analysis of data enables revision of prior opinions about the realization of goals…

Trade-offs are implicit in choosing a subjective or objective method for evaluating social programs. The differences between Bayesian and traditional statistics, decision and cost-benefit analysis, and anthropological and traditional case systems illustrate trade-offs in choosing methods because of limited resources. (SLD)

Evaluation is discussed as an information-gathering process. Currently popular evaluation programs are reviewed in relation to decision making and various approaches that seem to contribute to the decision utility of evaluation (e.g. classical approaches, Bayesian approaches, adaptive designs, and model-based evaluations) are described. (Author/AL)

In the late 1990s, the Korea Ministry of Education and Human Resources, in response to concern over the relatively low standing of the nation's universities and researchers, launched the Brain Korea 21 program BK21). BK21 seeks to make Korean research universities globally competitive and to produce more high-quality researchers in Korea. It…

Individual differences in response to a given treatment have been a longstanding interest in education. While many evaluation studies focus on average treatment effects (i.e., the effects of treatments on the levels of outcomes of interest), this paper additionally considers estimating the effects of treatments on the dispersion in outcomes.…