BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

This article discusses comparisons of means using exploratory and confirmatory approaches. Three methods are discussed: hypothesis testing, model selection based on information criteria, and Bayesian model selection. Throughout the article, an example is used to illustrate and evaluate the two approaches and the three methods. We demonstrate that…

Developmental research often involves studying change across 2 or more processes or constructs simultaneously. A natural question in this work is whether change in these 2 processes is related or independent. Associative latent transition analysis (ALTA) was designed to test hypotheses about the degree to which change in 2 discrete latent…

A subset of Statistical Process Control (SPC) methodology known as Control Charting is introduced. SPC methodology is a collection of graphical and inferential statistics techniques used to study the progress of phenomena over time. The types of control charts covered are the null X (mean), R (Range), X (individual observations), MR (moving…

Purpose: To deepen the understanding and to encourage further research on leadership best practices for sustaining quality improvement in UK higher education institutions (HEIs). Design/methodology/approach: The literature on leadership provides the theoretical context for the survey of quality managers from 42 UK HEIs. A mix of questionnaires,…

Presents a general framework for designing sampling programs that ensure cost effectiveness, and managed errors kept within known and acceptable limits. (LZ)

Presents two statistical topics and examples of their use in natural resource monitoring. The first topic deals with use of correlated observations in calculations of variance estimates for a regional mean, required sample size determination, and confidence intervals. The second topic concerns the use of Bayesian techniques in hypothesis testing.…

The purpose of this study was to evaluate the quality of experimental research in counseling and counselor education published from 1976 through 1984. The focus of the study was the methodology and reporting of the research rather than its relevance. Time was the independent variable of interest and three 3-year spans were chosen for examination:…

This paper examines possible explanations for the fact that evaluation results are rarely used. Most explanatory factors for use of results in decision making mentioned in the literature have been clustered in three categories of variables. They concern: (1) the making of decisions about the practical problem; (2) the way in which evaluation is…

Evaluates the hypothesis that boomtowns enter a period of generalized crisis and loss of traditional values/attitudes; considers impact of energy development on residents' involvement in/attachment to their community, and perceived quality of community services. Uses linear and systemic models on data from three intermountain communities…