A Bayesian approach to the evaluation of person fit in item response theory (IRT) models is presented. In a posterior predictive check, the observed value on a discrepancy variable is positioned in its posterior distribution. In a Bayesian framework, a Markov Chain Monte Carlo procedure can be used to generate samples of the posterior distribution…

When multiple regression is used to develop a prediction model, sample size must be large enough to ensure stable coefficients. If sample size is inadequate, the model may not predict well in future samples. Unfortunately, there are problems and contradictions among the various sample size methods in regression. For example, how does one reconcile…

The analysis of interaction effects in multiple regression has received considerable attention in recent years, but problems with the valid identification of moderating variables have been noted by researchers. G. McClelland and C. Judd (1993), in their discussion of the statistical difficulties of detecting interactions and moderating effects,…

J. Barnette and J. McLean (1996) proposed a method of controlling Type I error in pairwise multiple comparisons after a significant omnibus F test. This procedure, called Alpha-Max, is based on a sequential cumulative probability accounting procedure in line with Bonferroni inequality. A missing element in the discussion of Alpha-Max was the…

The purpose of this study was to investigate the effects of sample size on the power of five selected fit indices through a Monte Carlo simulation. Two models (a reduced and a complete model) and 6 sample sizes (20, 50, 100, 200, 500, and 1,000) were used to investigate the effect on the power of fit indices as the sample size was varied. The…

The probabilities of attaining varying magnitudes of standardized effect sizes by chance and when protected by a 0.05 level statistical test were studied. Monte Carlo procedures were used to generate standardized effect sizes in a one-way analysis of variance situation with 2 through 5, 6, 8, and 10 groups with selected sample sizes from 5 to 500.…

The purpose of this study was to examine the potential impact of selected methodological factors on the validity of conclusions from reliability generalization (RG) studies. The study focused on four factors; (1) missing data in the primary studies; (2) transformation of sample reliability estimates; (3) use of sample weights for estimating mean…

In this paper, six statistical tests of stochastic equality are compared with respect to Type I error and power through a Monte Carlo simulation. In the simulation, the skewness and kurtosis levels and the extent of variance heterogeneity of the two parent distributions were varied across a wide range. The sample sizes applied were either small or…

A study was conducted to extend the sequential probability ratio testing (SPRT) procedure with the polytomous model under some practical constraints in computerized classification testing (CCT), such as methods to control item exposure rate, and to study the effects of other variables, including item information algorithms, test difficulties, item…

In this paper a method is proposed whereby an investigator may improve the metric qualities of questionnaire and similar kinds of data. (Author)

The standard error of an equipercentile equating is derived for four situations. Some numerical results are checked by Monte Carlo methods. Numerical standard errors are computed for two sets of real data. Standard errors of linear and equipercentile equating are compared. (Author)

Using Monte Carlo generated item response data, this research sought to determine the effectiveness, sufficiency and similarity of selected techniques for detecting item bias. The three-parameter latent-trait test model was used to generate the simulated data. (Author/JKS)

The accuracy of three analytical formulas for shrinkage estimation and four empirical techniques were investigated in a Monte Carlo study of the coefficient of cross-validity in multiple regression. Substantial statistical bias was evident for all techniques except the formula of M. W. Brown (1975) and multicross-validation. (SLD)