Kelly's formula estimates sampling variance of correlation corrected for attenuation by using split-half reliabilities. In some cases, coefficient alpha estimate of reliability is preferable. A simulation study suggests a variation of Kelly's formula can be used appropriately with coefficient alpha. Kelly's formula is modified to accept…

The work of R. MacCallum et al. (1992) was extended by examining chance modifications through a Monte Carlo simulation. The stability of post hoc model modifications was examined under varying sample size, model complexity, and severity of misspecification using 2- and 4-factor oblique confirmatory factor analysis (CFA) models with four and eight…

Approximations were compared with exact statistics obtained on 85 different classroom tests constructed and administered by professors in a variety of fields; means and standard deviation of the resulting differences supported the use of approximations in practical situations. (Author)

Three measures of person-fit (the extent to which an examinee's response pattern on a multiple-choice test is consistent with his ability as estimated by total score) were computed for students taking classroom tests under 12 different instructors at a comprehensive university. Supplementary questions on each test inquired concerning students'…

Total circular triad scores (TCT) derived from the pair-comparison Minnesota Importance Questionnaire (MIQ) were used to study the relationship between inconsistency, and both internal consistency reliability and stability. Stability estimates (and Hoyt Coefficients) were computed for each of nine groups (retest internals from immediate retest to…

Reports a class exercise which requires students to recalculate the Chi-squares, t-tests, and one-way ANOVAs found in published psychological research articles. Describes students' reaction to the exercise and provides data on the 13% error rate they discovered. (Author/JDH)

This document investigates the widely used school climate assessment instrument, the CFK Ltd. School Climate Profile. Part A (General School Climate Factors) was administered by school to a junior high campus (n=257) and a high school campus (n=906) in a major metropolitan area in the Southwestern United States to gather data for administrative…

The average design effects for statistics estimated from the base-year National Longitudinal Study data are presented. Attempts to partition the effects into those due to stratification, clustering, and unequal weighting are discussed. The expected increases in subpopulation sample sizes due to oversampling are calculated and compared with the…

Longitudinal measures of change are the most important kinds of estimates being produced from the National Longitudinal Study of the High School Class of 1972 (NLS). Several topics are presented in this report, most of which build on previous variance components analyses. The major areas covered are effects of stratification and clustering,…

This paper reports the results of an evaluative statistical analysis of the instrument employed for student evaluation of faculty at Oakton Community College (Illinois). The analysis was performed because the locally devised instrument had never been subjected to systematic study of reliability or validity, and because a review of pertinent…

This report provides the statistical tools necessary to measure the extent of error that exists in organizational record data and group survey data. It is felt that traditional methods of measuring error are inappropriate or incomplete when applied to organizational groups, especially in studies of organizational change when the same variables are…

The stability of Rasch test item difficulty parameters was investigated under varying conditions. Data were taken from a mathematics achievement test administered to over 2,000 Australian students. The experiments included: (1) relative stability of the Rasch, traditional, and z-item difficulty parameters using different sample sizes and designs;…