The purpose of this study was to compare and contrast frameworks for evaluating methodological rigor in single case research. Specifically, research on high-probability requests to increase compliance in young children was evaluated. Ten studies were identified and were coded using 4 frameworks. These frameworks were the Council for Exceptional…

When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

Case-mix heterogeneity across studies complicates meta-analyses. As a result of this, treatments that are equally effective on patient subgroups may appear to have different effectiveness on patient populations with different case mix. It is therefore important that meta-analyses be explicit for what patient population they describe the treatment…

There are challenges in teaching research methodology as highlighted by many researchers. Among the challenges are strategies for putting material in context. For achieving this purpose, students' engagement in the learning process needs to be re-looked. This paper shares on a practice engaging students in a research methodology class. The…

This paper discusses investigations in science education addressing the nonlinear dynamical hypothesis. Learning science is a suitable field for applying interdisciplinary research and predominately for testing psychological theories. It was demonstrated that in this area the paradigm of complexity and nonlinear dynamics have offered theoretical…

The effective evaluation of correctional programs is critically important. However, research in corrections rarely allows for the randomization of offenders to conditions of the study. This limitation compromises internal validity, and thus, causal conclusions can rarely be drawn. Increasingly, researchers are employing propensity score matching…

We present a case study of the process through which a methodology was developed and applied to a quasi-experimental research study that employed propensity score matching. Methodological decisions are discussed and summarized, including an explanation of the approaches selected for each step in the study as well as rationales for these…

Multilevel models are often used to evaluate hypotheses about relations among constructs when data are nested within clusters (Raudenbush & Bryk, 2002), although alternative approaches are available when analyzing nested data (Binder & Roberts, 2003; Sterba, 2009). The overarching goal of this article is to suggest when it is appropriate…

This paper reports findings from a classroom based study with 5 year old children in their first term of school. A data modelling activity contextualised by a picture story book was used to present a prediction problem. A data table with numerical data values provided for three consecutive days of rubbish collection was provided, with a fourth day…

Randomized experiments are commonly used to evaluate if particular interventions improve student achievement. While these experiments can establish that a treatment actually "causes" changes, typically the participants are not randomly selected from a well-defined population and therefore the results do not readily generalize. Three…

Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in…

In his article, "An Alternative to Null-Hypothesis Significance Tests," Killeen (2005) urged the discipline to abandon the practice of "p[subscript obs]"-based null hypothesis testing and to quantify the signal-to-noise characteristics of experimental outcomes with replication probabilities. He described the coefficient that he…

This volume, a comprehensive survey and critical analysis of today's issues in mathematics education, distills research to build knowledge and capacity in the field. The compendium is a valuable new resource that provides the most comprehensive evidence about what is known about research in mathematics education. The 38 chapters present five…

Lecoutre, Lecoutre, and Poitevineau (2010) have provided sophisticated grounding for "p[subscript rep]." Computing it precisely appears, fortunately, no more difficult than doing so approximately. Their analysis will help move predictive inference into the mainstream. Iverson, Wagenmakers, and Lee (2010) have also validated…

This methodological note illustrates how a commonly used calculation of the Delta-p statistic is inappropriate for categorical independent variables, and this note provides users of logistic regression with a revised calculation of the Delta-p statistic that is more meaningful when studying the differences in the predicted probability of an…