The standardized group mean difference, Cohen's "d", is among the most commonly used and intuitively appealing effect sizes for group comparisons. However, reporting this point estimate alone does not reflect the extent to which sampling error may have led to an obtained value. A confidence interval expresses the uncertainty that exists between…

Differential item functioning (DIF) continues to receive attention both in applied and methodological studies. Because DIF can be an indicator of irrelevant variance that can influence test scores, continuing to evaluate and improve the accuracy of detection methods is an essential step in gathering score validity evidence. Methods for detecting…

An influential statistics test recommends a Levene text for homogeneity of variance. A recent note suggests that Levene's test is upwardly biased for small samples. Another report shows inflated Alpha estimates and low power. Neither study utilized more than two sample sizes. This Monte Carlo study involved sampling from a normal population for…

The Monte Carlo method was used, and the factors considered were (1) level of main effects in the population; (2) level of interaction effects in the population; (3) alpha level used in determining whether to pool; and (4) number of degrees of freedom. The results indicated that when the ratio degrees of freedom (axb)/degrees of freedom (within)…

This paper investigates three methods for comparing medians rather than means in studying two independent treatment groups. The method that gave the best results is based on a normal approximation of the distribution of the sample median where the variance is estimated using results reported by Maritz and Jarrett. (Author/JAZ)

To demonstrate that some methods used to assess item fit can be applied to assess person fit and vice versa, performance of a chi-squared item-fit statistic was compared with that of a likelihood-based person-fit statistic for examinees and items under Monte Carlo conditions. (SLD)

This article describes a Monte Carlo study of 2 methods for treating incomplete nonnormal data. Skewed, kurtotic data sets conforming to a single structured model, but varying in sample size, percentage of data missing, and missing-data mechanism, were produced. An asymptotically distribution-free available-case (ADFAC) method and structured-model…

A normally distributed data set of 1,000 values--ranging from 50 to 150, with a mean of 50 and a standard deviation of 20--was created in order to evaluate the bootstrap method of repeated random sampling. Nine bootstrap samples of N=10 and nine more bootstrap samples of N=25 were randomly selected. One thousand random samples were selected from…

The Feldt-Gilmer congeneric reliability coefficients make it possible to estimate the reliability of a test composed of parts of unequal, unknown length. The approximate standard errors of the Feldt-Gilmer coefficients are derived via a method using the multivariate Taylor's expansion. Monte Carlo simulation is employed to corroborate the…

A Monte Carlo Study was conducted to evaluate six models commonly used to evaluate change. The results revealed specific problems with each. Analysis of covariance and analysis of variance of residualized gain scores appeared to substantially and consistently overestimate the change effects. Multiple factor analysis of variance models utilizing…

A model of Brownian motion is discussed which includes viscosity effects. The model lends itself to Monte Carlo simulation and thus is suitable for an elementary physics laboratory experiment. (BB)

A program obtained random samples from known populations, some of which violated the homogeneity assumption. Student t tests and Mann-Whitney U Tests were performed on the sample value. Where the t test led to incorrect decisions, the use of Mann-Whitney U test in its place led to poorer results. (JAZ)

Conducted a Monte Carlo computer simulation of the ANOVA design to detect job differences. The design proved reasonably powerful in detecting differences. A second study used Monte Carlo methods to analyze the viability of techniques for determining job differences. Offers guidelines for selecting statistical techniques. (Author/RC)

The randomized response (RR) technique is often used to obtain answers on sensitive questions. A new method is developed to measure latent variables using the RR technique because direct questioning leads to biased results. Within the RR technique is the probability of the true response modeled by an item response theory (IRT) model. The RR…

False-positive and false-negative dicisions are the fundamental errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Accordingly, two methods of estimating the likelihood of committing these errors are described and then investigated using Monte Carlo techniques.…