The work of R. MacCallum et al. (1992) was extended by examining chance modifications through a Monte Carlo simulation. The stability of post hoc model modifications was examined under varying sample size, model complexity, and severity of misspecification using 2- and 4-factor oblique confirmatory factor analysis (CFA) models with four and eight…

In the present study Monte Carlo methods were employed to evaluate the degree to which canonical function and structure coefficients may be differentially sensitive to sampling error. Sampling error influences were investigated across variations in variable and sample (n) sizes, and across variations in average within-set correlation sizes and in…

Simulation studies were used to explore the relationship between Type I error rates (statistical conclusion validity) and multiple testing in data sets exhibiting varying degrees of independence. Implications for reporting and interpreting educational data are discussed, and methods of determining or reducing Type I error incidence are presented.…

Comparisons of the Wilcoxon test, Friedman test, and repeated-measures analysis of variance (ANOVA) on ranks in a computer simulation show that the Friedman test performs like the sign test whereas the ANOVA performs like the Wilcoxon test. Classification of these tests in introductory statistics textbooks should be revised. (SLD)

Computer simulations indicate that the correlation between baseline and change, by itself, does not invalidate the use of gain scores to measure change, but when the negative correlation is accompanied by decrease in variance from pretest to posttest, covariance is a superior measure of change. (SLD)

An equating design in which two groups of examinees from slightly different populations are administered a different test form with a subset of common items is widely used. This paper presents standard errors and a simulation that verifies the equation for large samples for an equipercentile equating procedure for this design. (Author/BS)

A modification of a test of the equality of nonindependent alpha reliability coefficients is proposed. It avoids the limitation that the product of the number of test parts times the number of subjects be quite large. Monte Carlo studies indicate that this test can be used in comparing interrater reliabilities. (SLD)

Meta-analytic methods were used to summarize results of Monte Carlo (MC) studies investigating the robustness of various statistical procedures for testing within-subjects effects in split-plot repeated measures designs. Through a literature review, accessible MC studies were identified, and characteristics (simulation factors) and outcomes (rates…