To assess the effect on discriminant analysis in terms of correct classification into two groups, the following parameters were systematically altered using Monte Carlo techniques: sample sizes; proportions of one group to the other; number of independent variables; and covariance matrices. The pairing of the off diagonals (or covariances) with…

Two strategies, derived from J. P. Schaffer (1986), were compared as tests of significance for a complete set of planned orthogonal contrasts. The procedures both maintain an experimentwise error rate at or below alpha, but differ in the manner in which they test the contrast with the largest observed difference. One approach proceeds directly to…

A Bayesian approach to the evaluation of person fit in item response theory (IRT) models is presented. In a posterior predictive check, the observed value on a discrepancy variable is positioned in its posterior distribution. In a Bayesian framework, a Markov Chain Monte Carlo procedure can be used to generate samples of the posterior distribution…

When multiple regression is used to develop a prediction model, sample size must be large enough to ensure stable coefficients. If sample size is inadequate, the model may not predict well in future samples. Unfortunately, there are problems and contradictions among the various sample size methods in regression. For example, how does one reconcile…

J. Barnette and J. McLean (1996) proposed a method of controlling Type I error in pairwise multiple comparisons after a significant omnibus F test. This procedure, called Alpha-Max, is based on a sequential cumulative probability accounting procedure in line with Bonferroni inequality. A missing element in the discussion of Alpha-Max was the…

The purpose of this study was to investigate the effects of sample size on the power of five selected fit indices through a Monte Carlo simulation. Two models (a reduced and a complete model) and 6 sample sizes (20, 50, 100, 200, 500, and 1,000) were used to investigate the effect on the power of fit indices as the sample size was varied. The…

The purpose of this study was to examine the potential impact of selected methodological factors on the validity of conclusions from reliability generalization (RG) studies. The study focused on four factors; (1) missing data in the primary studies; (2) transformation of sample reliability estimates; (3) use of sample weights for estimating mean…

In this paper, six statistical tests of stochastic equality are compared with respect to Type I error and power through a Monte Carlo simulation. In the simulation, the skewness and kurtosis levels and the extent of variance heterogeneity of the two parent distributions were varied across a wide range. The sample sizes applied were either small or…

A study was conducted to extend the sequential probability ratio testing (SPRT) procedure with the polytomous model under some practical constraints in computerized classification testing (CCT), such as methods to control item exposure rate, and to study the effects of other variables, including item information algorithms, test difficulties, item…

Several methods of constructing confidence intervals for Spearman's rho (rank correlation coefficient) (C. Spearman, 1904) were tested in a Monte Carlo study using 2,000 samples of 3 different sizes. Results support the continued use of Spearman's rho in behavioral research. (SLD)

Investigates the standard rounding rule for multiplication and division including its derivation from a basic assumption. Uses Monte-Carlo simulations to show that this rule predicts the minimum number of significant digits needed to preserve precision only 46.4% of the time and leads to a loss in precision 53.5% of time. Suggests an alternative…

A Monte Carlo simulation study compared the power and Type I errors of the Wilks lambda statistic and the statistic of M. L. Puri and P. K. Sen (1971) on transformed data in a one-way multivariate analysis of variance. Preferred test procedures, based on robustness and power, are discussed. (SLD)

A method for multidimensional scaling that is highly resistant to the effects of outliers is described. Some Monte Carlo simulations illustrate the efficacy of the procedure, which performs well with or without outliers. (SLD)

The accuracy of four empirical techniques to estimate shrinkage in multiple regression was studied through Monte Carlo simulation. None of the techniques provided unbiased estimates of the population squared multiple correlation coefficient, but the normalized jackknife and bootstrap techniques demonstrated marginally acceptable performance with…

A Monte Carlo study considers the use of meta analysis with the Solomon four-group design. Experiment-wise Type I error properties and the relative power properties of Stouffer's Z in the Solomon four-group design are explored. Obstacles to conducting meta analysis in the Solomon design are discussed. (SLD)