BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

Evaluations of vocational education and training (VET) programs play a key role in informing training policy in Australia and elsewhere. Increasingly, such evaluations use observational data from surveys or administrative collections to assess the effectiveness of VET programs and interventions. The difficulty associated with using observational…

This paper is based on previous studies in applying propensity score methods to study multiple treatment variables to examine the causal moderator effect. The propensity score methods will be demonstrated in a case study to examine the causal moderator effect, where the moderators are categorical and continuous variables. Moderation analysis is an…

Survey sampling is fundamentally an applied field. The goal in this book is to put an array of tools at the fingertips of practitioners by explaining approaches long used by survey statisticians, illustrating how existing software can be used to solve survey problems, and developing some specialized software where needed. This book serves at least…

Latent class analysis (LCA) is a statistical method used to identify subtypes of related cases using a set of categorical or continuous observed variables. Traditional LCA assumes that observations are independent. However, multilevel data structures are common in social and behavioral research and alternative strategies are needed. In this…

This article presents a discussion of mixed methods (MM) sampling techniques. MM sampling involves combining well-established qualitative and quantitative techniques in creative ways to answer research questions posed by MM research designs. Several issues germane to MM sampling are presented including the differences between probability and…

Most traditional models, frameworks, and findings that apply to the majority of students and faculty do not adequately apply to important subpopulations. The recommendations here will help researchers become more sensitive to the nuances among various educational subgroups, and to pay more attention to outliers.

Proposes a probabilistic mechanism to describe various forms of the Bradford phenomenon reported in bibliographic research. The inclusion of a time parameter in the model to allow predictions of dynamic systems is explained. (58 references) (CLB)

The probability of obtaining a significant statistic, using the parametric analysis of covariance (ANCOVA) and the rank transform ANCOVA, was estimated for three conditions defined in terms of conditional distributions for two groups. The distributions were both normal, both skewed in the same direction but to different degrees, or both skewed to…

Examines and rejects common criticisms of the causality concept; shows causality is a relation implied in the grammar of a language about objects. Discusses objective criteria for concepts of causal relations and explains how the concept of causality may be modified to have causes determine probabilities of outcomes. (Author/RH)

It is easy to observe that meta-analysis is quickly establishing itself as useful tool of the social sciences. Perusal of representative journals confirms that meta-analysis has been applied in various ways to diverse literatures. It is imperative, therefore, that reviewers, publishers, consumers, and critics of these reviews be best informed…

This paper encourages the use of multiple logistic analysis in early intervention research, to assess the degree of association of multiple factors (such as subject or situational characteristics) with a dichotomous outcome (such as benefitting or not benefitting from an intervention) and to estimate the probability of each outcome. (JDD)

This tutorial summarizes some of the widely known limitations of tests of statistical significance and then focuses on extracting measures of variation accounted for as a supplement to significance testing. Two measures of variation accounted for, eta squared and omega squared, are discussed. Computational formulas, computational examples, and…