Describing the variation in test scores between and within school districts is critical for: (1) for policy-related and descriptive work that investigates the sorting of students among districts and the differential effectiveness of those districts; and (2) for methodological work planning future experiments or interventions. Intraclass…

A method for comparing the cross validated classification accuracies of linear and quadratic classification rules is presented under varying data conditions for the k-group classification problem. With this method, separate-group as well as total-group proportions of correct classifications can be compared for the two rules. McNemar's test for…

A computer simulation compared significance tests of correlation coefficients calculated from initial scores, from ranks assigned by the Spearman method, and from three kinds of modified ranks. Implications of findings for the idea that rank correlation is a nonparametric correlation method are discussed. (SLD)

Formulas for estimating cross-validated hit-rates, the number of correct classifications into an a priori grouping structure, were examined. The following mathematical formulas were compared: McLachlan's formula estimator, two Snappin and Knoke smoothed formula estimators, and the analytic leave-one-out estimator. The R method was included as a…

The reliability of simple difference scores is greater than, less than, or equal to that of residualized difference scores, depending on whether the correlation between pretest and posttest scores is greater than, less than, or equal to the ratio of the standard deviations of pretest and posttest scores. (Author)

Multivariate methods were used to identify between-set factors relating the criterion set of eleven Wechsler Adult Intelligence Scale Revised subtest variables to the predictor set of demographic variables: age, race, sex, education, occupation, geographic region, and urban versus rural residence. Although factor analysis is usually used to…

Four methods for determining the dimensionality of a set of test items were compared: (1) linear factor analysis; (2) residual analysis; (3) nonlinear factor analysis; and (4) Bejar's method. Five artificial test data sets (for 40 items and 1500 examinees) were generated, consistent with the three-parameter logistic model and the assumption of…

To examine and clarify background conditions for understanding variables which affect salary, the salary and compensation programs at two industrial and three educational organizations were subjected to a statistical audit. Data were available on 272 employees. Ten compensation variables were studied as having direct or indirect effects on salary:…

The TESTFACT computer program and full-information factor analysis of test items were used in a computer simulation conducted to correct for the guessing effect. Full-information factor analysis also corrects for omitted items. The present version of TESTFACT handles up to five factors and 150 items. A preliminary smoothing of the tetrachoric…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

The focus of this study is on the estimation procedures implemented in BILOG, a computer program. One purpose is to compare the item parameter estimates produced by various procedures available in BILOG. Four different models are used: the one, two, and three parameter model and a three parameter model with common guessing parameters. The results…

The purpose of this study was to determine the validity of the American College Test (ACT) in predicting academic achievement of students from an area which is culturally, economically, and educationally depressed. The population, chosen from 6 community colleges serving the Appalachian region of Kentucky, consisted of 1,127 full time (12 or more…

This study investigated seven methods for analyzing multivariate group differences. Bonferroni t statistics, multivariate analysis of variance (MANOVA) followed by analysis of variance (ANOVA), and five other methods were studied using Monte Carlo methods. Methods were compared with respect to (1) experimentwise error rate; (2) power; (3) number…

The No Child Left Behind Act has brought great attention to the high school graduation rate as one of the mandatory accountability measures for public school systems. However, there is no consensus on how to calculate the high school graduation rate given the lack of longitudinal databases that track individual students. This study reviews…