The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

We examined whether 2 types of interpolated tasks (i.e., retrieval-practice via free recall or guessing a missing critical item) improved final recognition for related and unrelated word lists relative to restudying or completing a filler task. Both retrieval-practice and guessing tasks improved correct recognition relative to restudy and filler…

Weak performance in short-term memory (STM) in children with cochlear implants (CI) may have an impact on vocabulary development. Vocabulary, phonological STM (non-word repetition), phonological/verbal STM (digit span) and rapid naming measures were administered to 15 Greek-speaking children with CI (ages 4;6-8;6) and to chronological age (CA) and…

Researchers may have multiple motivations for combining disparate pieces of evidence in a meta-analysis, such as generalizing experimental results or increasing the power to detect an effect that a single study is not able to detect. However, while in meta-analysis, the main question may be simple, the structure of evidence available to answer it…

Propensity score applications are often used to evaluate educational program impact. However, various options are available to estimate both propensity scores and construct comparison groups. This study used a student achievement dataset with commonly available covariates to compare different propensity scoring estimation methods (logistic…

Errors in detecting randomness are often explained in terms of biases and misconceptions. We propose and provide evidence for an account that characterizes the contribution of the inherent statistical difficulty of the task. Our account is based on a Bayesian statistical analysis, focusing on the fact that a random process is a special case of…

In the present study we used bayesian latent growth modeling to asses the impact of a one-semester creativity course on the development of engineering students' creativity scripts. We compared a treatment (N = 52) and a control (N = 42) group with respect to individual differences in initial status and in rate of change. Results revealed that the…

During the 2009-2010 school year, Marzano Research Laboratory (MRL) was commissioned by Promethean Ltd. to conduct a second year evaluation study of the effects of Promethean ActivClassroom on student academic achievement. This report describes the findings from the second year study along with aggregate findings from the first and second year…