Researchers continue to choose PCA in scale development and adaptation studies because it is the default setting and overestimates measurement quality. When PCA is utilized in investigations, the explained variance and factor loadings can be exaggerated. PCA, in contrast to the models given in the literature, should be investigated in…

In random-effects meta-analysis the between-study variance ([tau][superscript 2]) has a key role in assessing heterogeneity of study-level estimates and combining them to estimate an overall effect. For odds ratios the most common methods suffer from bias in estimating [tau][superscript 2] and the overall effect and produce confidence intervals…

Randomized experiments are commonly used to evaluate the effectiveness of educational interventions. The goal of the present investigation is to develop small-sample corrections for multiple contrast hypothesis tests (i.e., F-tests) such as the omnibus test of meta-regression fit or a test for equality of three or more levels of a categorical…

The problem of chance model modifications under varying levels of sample size, model size, and severity of misspecification in confirmatory factor analysis models was examined through Monte Carlo simulations. Findings suggest that practitioners should exercise caution when interpreting modified models unless sample size is quite large. (SLD)

The impact of outliers on Cronbach's coefficient [alpha] has not been documented in the psychometric or statistical literature. This is an important gap because coefficient [alpha] is the most widely used measurement statistic in all of the social, educational, and health sciences. The impact of outliers on coefficient [alpha] is investigated for…

Using computer simulated data, the Type I error rate and statistical power were empirically estimated for several pairwise multiple comparison strategies for situations where population variances differ. Focus was on comparing modified Bonferroni procedures with Dunnett's solutions, and determining whether or not J. P. Shaffer's suggestion of…

While it is imperative that attempts be made to assess the predictive accuracy of any prediction model, traditional measures of predictive accuracy have been criticized as suffering from "the base rate problem." The base rate refers to the relative frequency of occurrence of the event being studied in the population of interest, and the…

Provides asymptotic formulas for the standard errors of parameter estimates from the NOHARM computer program for restricted and unrestricted rotated models, using large-sample theory, and a goodness-of-fit test of the model. Used simulation to show that results from NOHARM are comparable to the three-stage estimator of B. Muthen (1993). (SLD)

This Monte Carlo simulation studied the relative power of 8 tests for sphericity in randomized block designs where sample size was small (10, 15, 20, and 30) and population covariance matrices of dimension-to-sample size ratio approached 1.0. The locally best invariant test demonstrated substantial power to detect departures from sphericity. (SLD)

A new index for assessing the dimensionality underlying a set of test items was investigated. The incremental fit index (IFI) is based on the sum of squares of the residual covariances. Purposes of the study were to: (1) examine the distribution of the IFI in the null situation, with truly unidimensional data; (2) examine the rejection rate of the…

The application of latent trait theory to classroom tests necessitates the use of small sample sizes for parameter estimation. Computer generated data were used to assess the accuracy of estimation of the slope and location parameters in the two parameter logistic model with fixed abilities and varying small sample sizes. The maximum likelihood…

The effects of sample size, number of variables, and population value of the congruence coefficient on the sampling distribution of the congruence coefficient were examined. Sample data were generated on the basis of the common factor model, and principal axes factor analyses were performed. (Author/LMO)

Studies of differential item functioning (DIF) under item response theory require that item parameter estimates be placed on the same metric before comparisons can be made. Evidence that methods for linking metrics may be influenced by the presence of differentially functioning items has been inconsistent. The effects of three methods for linking…

Five comparisons were made relative to the quality of estimates of ability parameters and item calibrations obtained from the one-parameter and three-parameter logistic models. The results indicate: (1) The three-parameter model fit the test data better in all cases than did the one-parameter model. For simulation data sets, multi-factor data were…

Hierarchical Bayes procedures were compared for estimating item and ability parameters in item response theory. Simulated data sets from the two-parameter logistic model were analyzed using three different hierarchical Bayes procedures: (1) the joint Bayesian with known hyperparameters (JB1); (2) the joint Bayesian with information hyperpriors…