A model which approaches the problem of characterizing distributions of test validity correlation coefficients from the perspective of finite mixture theory is presented. This estimation method offers advantages over validity generalization procedures. Examples are provided to illustrate applications of the method. (SLD)

Path analytic techniques for assessing the validity of indicators in multitrait-multimethod matrices represent improvements on Campbell and Fiske's early procedures for testing for validity. The diagnosis of indicator ills by means of confirmatory factor analysis is especially useful. An empirical example of these techniques is presented.…

The strategy for investigating convergent and discriminant test validity, known as the multitrait-multimethod matrix, is investigated. A nonparametric significance testing procedure is suggested and demonstrated. (JKS)

A mathematical link between test reliability and test validity is derived, taking into account the correlation between error scores on a test and error scores on a criterion measure. When this correlation is positive, the "paradoxical" nonmonotonic relation between test reliability and test validity occurs universally. (Author/BW)

Path analyses of two multitrait-multimethod matrices are used as examples of the kind of information afforded by application of the technique. It is concluded that the technique should be of considerable aid to researchers who want to evaluate the convergent and discriminant validity of their measures. (Author/CTM)

This annotated bibliography was developed upon noting a deficiency of information in the literature regarding the training of raters for establishing agreement. The ERIC descriptor, "Interrater Reliability", was used to locate journal articles. Some of the 33 resulting articles focus on mathematical concepts and present formulas for computing…

Checking of parametric assumptions is an often ignored step in the inferential process. A misconception regarding symmetry (one aspect of "robustness") is prevalent: that in nonsymmetric distributions the mean and median are always non-coincidental. It is to this fallacious point that the discussion is directed. A generally accepted index of…

Common approaches to examining the relationship between multitrait-multimethod (MTMM) data and variables outside the MTMM data are compared: averaging various means of each trait and estimating LISREL computer program models, and estimating only relationships between MTMM traits and the outside variables. Problems of correlational bias are…

This study investigated the convergent validity of expert-system scores for four mathematical constructed-response item formats. A five-factor model was proposed comprised of four constructed-response format factors and a Graduate Record Examinations (GRE) General Test quantitative factor. Subjects were drawn from examinees taking a single form of…

This study tested the multifaceted, hierarchical structure of self- concept (SC) against alternative models and determined whether academic SC can be discriminated from academic grades. Results supported the multidimensional interpretation of SC and demonstrated that general SC could be interpreted as distinct from but correlated with academic SC.…

Previous research has studied the effects of different methods of item option weighting on the reliability and concurrent and predictive validity of achievement tests. Increases in reliability are generally found, but with mixed results for validity. Several methods of producing option weights, (i.e., Guttman internal and external weights and…

The purpose of this study was to determine whether option weighting improved the internal consistency and intercorrelation of the subtests. The differential option-weighting scheme employed in this study is based on one devised by Guttman. The tests were first scored with Guttman-type weights and then with conventional correction-for-guessing…