We investigate the reliability of data from the Wage Indicator (WI), the largest online survey on earnings and working conditions. Comparing WI to nationally representative data sources for 17 countries reveals that participants of WI are not likely to have been representatively drawn from the respective populations. Previous literature has…

The finite population correction (FPC) factor is often used to adjust variance estimators for survey data sampled from a finite population without replacement. As a replicated resampling approach, the jackknife approach is usually implemented without the FPC factor incorporated in its variance estimates. A paradigm is proposed to compare the…

In order to investigate causality in situations where random assignment is not possible, propensity scores can be used in regression adjustment, stratification, inverse-probability treatment weighting, or matching. The basic concepts behind propensity scores have been extensively described. When data are longitudinal or missing, the estimation and…

The Common Core State Standards for Mathematics have a widespread impact on children's statistical learning opportunities. The Grade 6 standards are particularly ambitious in the goals they set. In this critique, experiences helping children work toward the Grade 6 Common Core statistics expectations are used in conjunction with previous research…

The purpose of this article is to develop a statistical model that best explains variability in the number of school days suspended. Number of school days suspended is a count variable that may be zero-inflated and overdispersed relative to a Poisson model. Four models were examined: Poisson, negative binomial, Poisson hurdle, and negative…

Ecological momentary assessment (EMA) is a popular assessment method in psychology that aims to capture events, emotions, and cognitions in real time, usually repeatedly throughout the day. Because EMA typically involves more intensive monitoring than traditional assessment methods, missing data are commonly an issue and this missingness may bias…

There has been a wealth of research conducted on the high school dropouts spanning several decades. It is estimated that compared with those who complete high school, the average high school dropout costs the economy approximately $250,000 more over his or her lifetime in terms of lower tax contributions, higher reliance on Medicaid and Medicare,…

We consider the relative performance of two common approaches to multiple imputation (MI): joint multivariate normal (MVN) MI, in which the data are modeled as a sample from a joint MVN distribution; and conditional MI, in which each variable is modeled conditionally on all the others. In order to use the multivariate normal distribution,…

Often it is infeasible or unethical to use random assignment in educational settings to study important constructs and questions. Hence, educational research often uses observational data, such as large-scale secondary data sets and state and school district data, and quasi-experimental designs. One method of reducing selection bias in estimations…

WebQuests are designed to ensure meaningful learning by combining technology with a constructivist approach in the classroom setting. This study aims to examine the effect of WebQuests used in instruction on students' academic achievements and the student and teacher opinions on WebQuests. The participants of this study using the…

Complex survey data, as highlighted in this issue of "Evaluation Review", provide a wealth of opportunities for answering methodological and/or applied research questions. However, the analytic issues of nonindependence and unequal selection probability must be addressed when analyzing this type of data. Thus, to ensure that research questions are…

The use of dual credit has been expanding rapidly. Dual credit is a college course taken by a high school student for which both college and high school credit is given. Previous studies provided limited quantitative evidence that dual credit/dual enrollment is directly connected to positive student outcomes. In this study, predictive statistics…

Dual Process Theories (DPT) of reasoning posit that judgments are mediated by both fast, automatic processes and more deliberate, analytic ones. A critical, but unanswered question concerns the issue of monitoring and control: When do reasoners rely on the first, intuitive output and when do they engage more effortful thinking? We hypothesised…

This paper describes three spreadsheet exercises demonstrating the nature and frequency of type I errors using random number generation. The exercises are designed specifically to address issues related to testing multiple relations using correlation (Demonstration I), t tests varying in sample size (Demonstration II) and multiple comparisons…

Statistics teaching should not be carried out in the same way for all kinds of university students. Instead, teaching statistics should take into account the different fields of study that students have chosen. For example, students of sciences or engineering have different interests and backgrounds compared to students of any social or juridical…