An error in an essential equation within the article by Williams and Zimmerman is corrected, and the algebraic inequalities are translated into questions a researcher can ask about simple or residualized difference scores. Williams and Zimmerman acknowledge the error and note that main conclusions are not affected. (SLD)

A Bayesian alternative to interpretations based on classical reliability theory is presented. Procedures are detailed for calculation of a posterior score and credible interval with joint consideration of item sample and occasion error. (Author/SLD)

The formula developed by R. Levine (1955) for equating unequally reliable tests is described. The formula can be interpreted as a method of moments estimate of an equating function that results in first order equity of the equated test score under a classical congeneric model. (TJH)

D.V. Budescu and J.L. Rogers (1981) proposed a method of adjusting correlations of scales to eliminate spurious components resulting from the overlapping of scales. Three reliability correction formulas are derived in this article that are based on more tenable assumptions. (SLD)

The internal correlation--a measure of dependency in a set of variables--is discussed and generalized. Applications of the internal correlation coefficient and its generalizations are given for several data-analytic situations. The internal correlation is illustrated and the concept is expanded to a series of additional indices. (TJH)

Use of internal correlation for statistical analysis--proposed by G. W. Joe and J. L. Mendoza (1989)--is discussed. Focus is on the "content" question (what this application can do with the information that statistics contain) and the "eloquence" question (the advantages of this means of encoding information over other means). (TJH)

The use of confirmatory factor analysis by the LISREL program is demonstrated as an assumption-testing method when computing reliability coefficients under different model assumptions. Results indicate that reliability estimates are robust against departure from the assumption of parallelism of test items. (SLD)

Designing a test using three-parameter item response theory (IRT) is discussed. A brief review of IRT is followed by a discussion of two types of test design: (1) selecting items using confidence envelopes (confidence envelope method); and (2) using item characteristic curves and their confidence intervals (test envelope method). The confidence…

Scoring of response vectors to give maximum test-retest correlation is investigated. A general method is given for finding the best scores, deriving them for the normal factor model, and showing that for a standard model for binary response it is easy to approximate the best scores. (SLD)

The psychometric objections to using essays and other subjective tests for measurement can be overcome by a many-facet Rasch model. This model enables judge-awarded grades to be transformed from their arbitrary, local, non-linear rating scale form into linear measures with explicit generalizable meaning of specifiable reliability (standard error)…

A brief overview is provided of the Conger-Lipshitz approach to estimating the reliability of a profile or test battery. A computational example from a recent study shows how canonical reliability can be obtained through existing statistical software. (SLD)

Some of the methods originally used to find relationships between reliability and power associated with a single measurement are extended to difference scores. Results, based on explicit power calculations, show that augmenting the reliability of measurement by reducing error score variance can make significance tests of difference more powerful.…

Test validity is a concept that has often been ignored in the context of latent trait models and in modern test theory, particularly as it relates to computerized adaptive testing. Some considerations about the validity of a test and of a single item are proposed. This paper focuses on measures that are population-free and that will provide local…

Generalizability theory (G-theory) and many-facet Rasch measurement (Rasch) manage the variability inherent when raters rate examinees on test items. The purpose of G-theory is to estimate test reliability in a raw score metric. Unadjusted examinee raw scores are reported as measures. A variance component is estimated for the examinee…

This computer program, written in BASIC, performs three different calculations of test reliability: (1) the Kuder-Richardson method; (2); the "common split-half" method; and (3) the Rulon-Guttman split-half method. The program reads sequential access data files for microcomputers that have been set up by statistical packages such as…