This article provides a framework for reporting internal consistency reliability in counseling research and other related social science fields, including guidelines relative to score reliability coefficients and associated confidence intervals for both full sample and subgroups. Follow-up techniques for investigating low score reliability are…

Provides example applications of constrained principal component analysis (CPCA) that illustrate the method on a variety of contexts common to psychological research. Two new analyses, decompositions into finer components and fitting higher order structures, are presented, followed by an illustration of CPCA on contingency tables and the CPCA of…

States of 40 newborn infants were observed during 2, 35- to 70-minute periods that were separated by 6-48 hours. Analyses identified 3 state profiles that differentiated infants on a behavioral assessment measure at 2 weeks of age. Scores showed significant agreement on individual differences in neurologically based measures. (RH)

Test homogeneity and internal consistency reliability indices were developed on the basis of theoretical considerations of properties of hierarchical structures of data matrices. This reconceptualization, in terms of ordinal test theory, has potential for explication of the mutual relationship of test reliability and homogeneity. (TJH)

Examined reliability of United States Employment Service Interest Inventory (USES-II) by twice administering USES-II to 100 vocational rehabilitation clients. Retest reliability coefficients for the 12 scales of the USES-II ranged from .73 to .88 with a median of .83 for this population. Findings support use of USES-II in occupational exploration…

Sampling theory for the intraclass reliability coefficient, a Spearman-Brown extrapolation of alpha to a single measurement for each examinee, is less recognized and less cited than that of coefficient alpha. Techniques for constructing confidence intervals and testing hypotheses for the intraclass coefficient are presented. (SLD)

Similarity between pairs of scores with a common mean and variance can be expressed in terms of the absolute differences between them. The distribution of such absolute differences between pairs of normally distributed scores with a common mean and variance is discussed, with procedures for calculating moments and areas within this distribution.…

Describes the mastering and replication process for CD-ROMs. Costs are discussed, the production cycle of a CD-ROM is explained, packaging is described, testing to increase the reliability of discs is discussed, and a directory of mastering and replication facilities is provided. (LRW)

Published Lester Attitude toward Death Scale for first time, together with data on its reliability and validity. Notes that scale is different from other fear of death scales in its use of scaled value approach that permits measure of inconsistency in attitudes. (Author)

An approach is presented that can predict internal consistency of cognitively complex assessments on two dimensions, those of adding tasks with similar or different solution strategies and adding test takers with different solution strategies. Data from the 1992 National Assessment of Educational Progress mathematics assessment are used to…

Describes a Statistical Analysis System (SAS) MACRO for computing various indices of interrater agreement, including a new generalizability coefficient, for categorical data in a single-facet, crossed design. (Author/SLD)

Proposes true score models that can account for correlated errors and their effect on coefficient alpha. These models allow random measurement errors on earlier items to affect directly or indirectly the scores on later items. Conditions under which coefficient alpha may yield spuriously high estimates or reliability are discussed. (SLD)

Standard-setting techniques concerning testing, comparisons of these techniques, and methods for assessing interrater and intrarater reliability are described. These techniques are discussed in relation to counselor education programs. (Author/MKA)

Reviews issues, raised in part because of "Educational and Psychological Measurement" (EPM) policies, regarding "test reliability," which is psychometric terminology, and "score reliability," score-centric terminology. Discusses datametrics and provides a critique of T. Vacha-Haase's proposed meta-analytic reliability generalization via…

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)