Whereas some research on immediate recall of verbal lists has suggested that it is limited by the number of chunks that can be recalled (e.g., N. Cowan, Z. Chen, & J. N. Rouder, 2004; E. Tulving & J. E. Patkau, 1962), other research has suggested that it is limited by the length of the material to be recalled (e.g., A. D. Baddeley, N. Thomson, &…

The extent to which a scale score generalizes to a latent variable common to all of the scale's indicators is indexed by the scale's general factor saturation. Seven techniques for estimating this parameter--omega[hierarchical] (omega[subscript h])--are compared in a series of simulated data sets. Primary comparisons were based on 160 artificial…

The authors present a Markov Chain Monte Carlo (MCMC) parameter estimation procedure for the generalized graded unfolding model (GGUM) and compare it to the marginal maximum likelihood (MML) approach implemented in the GGUM2000 computer program, using simulated and real personality data. In the simulation study, test length, number of response…

One conceptualization of meta-analysis is that studies within the meta-analysis are sampled from populations with mean effect sizes that vary (random-effects models). The consequences of not applying such models and the comparison of different methods have been hotly debated. A Monte Carlo study compared the efficacy of Hedges and Vevea's…

Generative response modeling is an approach to test development and response modeling that calls for the creation of items in such a way that the parameters of the items on some response model can be anticipated through knowledge of the psychological processes and knowledge required to respond to the item. That is, the computer would not merely…

By employing a concomitant variable, researchers can reduce the error, increase the precision, and maximize the power of an experimental design. Blocking and analysis of covariance (ANCOVA) are most often used to harness the power of a concomitant variable. Whether to block or covary and how many blocks to be used if a block design is chosen…

This Monte Carlo study examined strategies for forming the matching variable for the Mantel-Haenszel (MH) differential item functioning (DIF) procedure. Data were generated using a three-parameter logistic item response theory model, with common guessing parameters. The number of subjects and test length were manipulated, as were the difficulty,…

The Bootstrap method, a computer-intensive statistical method of estimation, is illustrated using a simple and efficient Statistical Analysis System (SAS) routine. The utility of the method for generating unknown parameters, including standard errors for simple statistics, regression coefficients, discriminant function coefficients, and factor…

Concern over the validity of statistical tests performed on data that may not satisfy underlying assumptions has prompted methodological researchers to perform Monte Carlo studies for frequently used tests. Unfortunately, these studies appear to have had little impact on methodological practice. One reason is the lack of an overarching framework…

The purpose of this study was to develop a single procedure for comparing population variances which could be used for distribution forms. Bootstrap methodology was used to estimate the variability of the sample variance statistic when the population distribution was normal, platykurtic and leptokurtic. The data for the study were generated and…

The Random Normal Scores Test (RNST) has been suggested as a powerful alternative to the use of the parametric analysis of variance (ANOVA) test when the underlying population is non-normally distributed. The major support for this suggestion rests on asymptotic theory. An empirical analysis of the RNST performed under the F and Chi-square…

Factors affecting a lower-bound estimate of internal consistency reliability, Cronbach's coefficient alpha, are explored. Theoretically, coefficient alpha is an estimate of the correlation between two tests drawn at random from a pool of items like the items in the test under consideration. As a practical matter, coefficient alpha can be an index…

J. A. Emrick's (1971) model is a latent class model of mastery testing that can be used to estimate the proportion of masters in a given population. A. Hamerle (1980), in a recent paper on this model, has proposed an estimator for the proportion of masters that is claimed to constitute a maximum likelihood approach. It is indicated that Hamerle is…

Meta-analysis is a technique for combining the summary statistics from previously conducted research studies to indicate the direction of results and provide an index of the magnitude of effect size. This paper focuses on the effect of the violation of the assumption of independence (that the value of any included statistic is in no way…

A normally distributed data set of 1,000 values--ranging from 50 to 150, with a mean of 50 and a standard deviation of 20--was created in order to evaluate the bootstrap method of repeated random sampling. Nine bootstrap samples of N=10 and nine more bootstrap samples of N=25 were randomly selected. One thousand random samples were selected from…