The theoretical reason for the presence of differential item functioning (DIF) is that data are multidimensional and two groups of examinees differ in their underlying ability distribution for the secondary dimension(s). Therefore, the purpose of this study was to determine how much the secondary ability distributions must differ before DIF is…

On the one hand, a growing amount of research discusses support for improving online collaborative learning quality, and many indicators are focused to assess its success. On the other hand, thinkLets for designing reputable and valuable collaborative processes have been developed for more than ten years. However, few studies try to apply…

Business analytics courses, such as marketing research, data mining, forecasting, and advanced financial modeling, have substantial predictive modeling components. The predictive modeling in these courses requires students to estimate and test many linear regressions. As a result, false positive variable selection ("type I errors") is…

The primary purpose of this quantitative study was to examine if simulation training correlated with the decision-making abilities of firefighters from two departments (one in a mountain state and one in a southwest state). The other purposes were to determine if firefighter demographics were correlated with the completion of the simulation…

In a provocative and influential paper, Jesse Rothstein (2010) finds that standard value-added models (VAMs) suggest implausible future teacher effects on past student achievement, a finding that obviously cannot be viewed as causal. This is the basis of a falsification test (the Rothstein falsification test) that appears to indicate bias in VAM…

Interaction and quadratic effects in latent variable models have to date only rarely been tested in practice. Traditional product indicator approaches need to create product indicators (e.g., x[superscript 2] [subscript 1], x[subscript 1]x[subscript 4]) to serve as indicators of each nonlinear latent construct. These approaches require the use of…

Researchers conducting studies involving individuals with exceptionalities are often prevented from involving large numbers of participants in their study samples. When this is the case, some say significant correlations are likely to replicate because the relation between two variables must be robust enough to be detected even with low…

This study examined the relationship between human patient simulation (HPS), critical thinking skills, and knowledge acquisition after HPS was integrated across the curriculum of an associate degree nursing program to determine if differences existed in critical thinking and knowledge of students based on the fidelity of HPS used and amount of…

It is demonstrated that tests of homogeneity of independent correlation coefficients based on the simple forms of the normal and t approximations to the distribution of the correlation coefficients are comparable in terms of robustness, size and power. (Author)

Confidence intervals are widely accepted as a preferred way to present study results. They encompass significance tests and provide an estimate of the magnitude of the effect. However, comparisons of correlations still rely heavily on significance testing. The persistence of this practice is caused primarily by the lack of simple yet accurate…

A common mistake in analysis of cluster randomized trials is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects. This…

The type I error rate in stepwise regression analysis deserves serious consideration by researchers. The problem-wide error rate is the probability of selecting any variable when all variables have population regression weights of zero. Appropriate significance tests are presented and a Monte Carlo experiment is described. (Author/CTM)

The negative bias of biserial correlations in the presence of guessing is demonstrated by Monte Carlo studies, and another estimator is described that is free of such bias. The usual biserial-correlation assumptions and assumptions about guessing are discussed. Brogden's coefficient of selective efficiency and the triserial correlation are…

A Monte Carlo technique was used to investigate the effect of the differences in covariate means among treatment groups on the significance level and the power of the F-test of the analysis of covariance. (Author/GDC)

Statistics used to estimate the population correlation ratio were reviewed and evaluated. The sampling distributions of Kelly's and Hays' statistics were studied empirically by computer simulation within the context of a three level one-way fixed effects analysis of variance design. (Author/RC)