Most methods for structural equation modeling (SEM) focused on the analysis of covariance matrices. However, "Historically, interesting psychological theories have been phrased in terms of correlation coefficients." This might be because data in social and behavioral sciences typically do not have predefined metrics. While proper methods…

The Vale and Maurelli algorithm is a widely used method that allows researchers to generate multivariate, nonnormal data with user-specified levels of skewness, excess kurtosis, and a correlation structure. Before obtaining the desired correlation structure, a transitional step requires the user to calculate the roots of a cubic polynomial…

In this article, we propose using the Bayes factors (BF) to evaluate person fit in item response theory models under the framework of Bayesian evaluation of an informative diagnostic hypothesis. We first discuss the theoretical foundation for this application and how to analyze person fit using BF. To demonstrate the feasibility of this approach,…

A common methodological problem in the evaluation of the predictive validity of selection methods, e.g. in educational and employment selection, is that the correlation between predictor and criterion is biased. Thorndike's (1949) formulas are commonly used to correct for this biased correlation. An alternative approach is to view the selection…

We extend a unified and easy-to-use approach to measurement error and missing data. In our companion article, Blackwell, Honaker, and King give an intuitive overview of the new technique, along with practical suggestions and empirical applications. Here, we offer more precise technical details, more sophisticated measurement error model…

We investigated methods of including covariates in two-level models for cluster randomized trials to increase power to detect the treatment effect. We compared multilevel models that included either an observed cluster mean or a latent cluster mean as a covariate, as well as the effect of including Level 1 deviation scores in the model. A Monte…

Educational researchers commonly use the rule of thumb of "design effect smaller than 2" as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models…

This article investigates the use of teacher value-added estimates to assess the distribution of effective teaching across students of varying socioeconomic disadvantage in the presence of classroom composition effects. We examine, via simulations, how accurately commonly used teacher value-added estimators recover the rank correlation between…

In order to examine metacognitive accuracy (i.e., the relationship between metacognitive judgment and memory performance), researchers often rely on by-participant analysis, where metacognitive accuracy (e.g., resolution, as measured by the gamma coefficient or signal detection measures) is computed for each participant and the computed values are…

Real world data often fail to meet the underlying assumptions of normal statistical theory. Many statistical procedures in the psychological and educational sciences involve models that may include a system of statistical equations with non-normal correlated variables (e.g., factor analysis, structural equation modeling, or other complex…

Proposes a procedure for generating multivariate nonnormal distributions. The procedure, an extension of the Fleishman power method (A. Fleishman, 1978), generates the average value of intercorrelations much closer to population parameters than competing procedures for skewed and heavy tailed distributions and small sample sizes. Reports Monte…

A method for estimating the first eigenvalue of random data correlation matrices is reported, and its precision is demonstrated via comparison to the method of S. J. Allen and R. Hubbard (1986). Data generated in Monte Carlo simulations with 10 sample sizes reaching up to 1,000 were used. (SLD)

Effects of violating the independence assumption when combining correlation coefficients in a meta-analysis were studied. This Monte-Carlo simulation varied sample size, predictor number, population intercorrelation among predictors, and population correlation between predictors and criterion. Combining statistics from nonindependent data in a…

A mathematical formula is introduced for the effect of integrating data. A method is then derived to eliminate the effect from correlations of variables, including mean composites, thus allowing for a clustering algorithm that requires allocation of variables according to the magnitude of their correlations. Examples illustrate the procedure. (SLD)

A model and computation procedure based on classical test score theory are presented for determination of a correlation coefficient corrected for attenuation due to unreliability. Delta and Monte Carlo method applications are discussed. A power analysis revealed no serious loss in efficiency resulting from correction for attentuation. (TJH)