The use of standards-based classroom assessments to test English learners' language proficiency is increasingly prevalent in the United States and many other countries. In a large urban school district in California, for example, a classroom assessment is used to make high-stakes decisions about English learners' progress from one level to the…

The construct validity of responses to the Tennessee Self Concept Scale (TSCS) was evaluated in two sets of analyses. First, exploratory and confirmatory factor analyses, and an analysis of variance model adapted from multitrait-multimethod (MTMM) research, were used to examine the internal structure of the TSCS responses. Second, MTMM analyses…

Confirmatory factor analysis (CFA) was used to model a multitrait by multisource matrix to determine the convergent and discriminant validity of measures of attention-deficit hyperactivity disorder (ADHD)-inattention (IN), ADHD-hyperactivity/impulsivity (HI), and oppositional defiant disorder (ODD) in 917 Malaysian elementary school children. The…

An extension of latent state-trait (LST) theory to hierarchical LST models is presented. In hierarchical LST models, the covariances between 2 or more latent traits are explained by a general 3rd-order factor, and the covariances between latent state residuals pertaining to different traits measured on the same measurement occasion are explained…

Seven hierarchical clustering methods were applied to the Wechsler Adult Intelligence Scale-Revised (WAIS-R) scores of 121 medical rehabilitation clients to investigate the possibility of method-dependent results and determine the stability of the clusters. This multiple-methods cluster analysis suggests that the underlying constructs of the…

The purpose of this study was to investigate convergent and discriminant validity of the five-factor model of adolescent personality in a school setting using three different raters (methods): self-ratings, peer ratings, and teacher ratings. The authors investigated validity through a multitrait-multimethod matrix and a confirmatory factor…

Agreement between two independent reviews of each of 278 manuscripts was compared on an overall recommendation and on specific rating items. Agreement between reviewers on separate dimensions, the unweighted sum of the dimensions, and various weighted sums was no better than that for the overall recommendation itself. (SLD)

Reexamines a 49-year-old study of P technique applied to a psychotherapy patient with a recurrent physical symptom. Explores dimensions of psychotherapeutic change as well as the context for the recurrent symptom. Illustrates the contributions from applying the P technique to psychotherapy research, to psychosomatic medicine, and to personality…

Whether 12 university students could discriminate validly between the correctness and originality of responses of 150 elementary school children to 3 creativity tests was studied as a determination of the discriminant validity of the tests through the multitrait-multimethod procedure. There was compelling evidence for convergent and discriminant…

Several multivariate statistical methodologies have been proposed to ensure objective and quantitative evaluation of the multitrait-multimethod matrix. The paper examines the performance of confirmatory factor analysis and covariance component models. It is shown, both empirically and formally, that confirmatory factor analysis is not a reliable…

The relationship of multiple linear regression to various multivariate statistical techniques is discussed. The importance of the standardized partial regression coefficient (beta weight) in multiple linear regression as it is applied in path, factor, LISREL, and discriminant analyses is emphasized. The multivariate methods discussed in this paper…

In an extension of research on the Marsh/Shavelson model of self-concept, a set of 14 academic self-concept scales was related to school performance in 8 subjects for 507 Australian high school boys. Findings indicate that components of academic self-concept are more differentiated and content-specific than assumed. (SLD)

This study examined the factor structure of the parent and teacher versions of the Strengths and Difficulties Questionnaire (SDQ; R. Goodman, 1997) with a sample of first-grade children at risk for educational failure. The 5-factor model previously found in studies using exploratory factor analysis was fit to the data for both parent and teacher…

Data from the authors' previous research (1979, 1980, 1987), consisting of responses to five masculinity-femininity (M-F), two esteem, and two social desirability instruments, were reanalyzed. The subjects were 104 male and 133 female college students who completed the: Bem Sex Role Inventory, Personal Attributes Questionnaire, ANDRO instrument…

Construct validity findings from Campbell-Fiske and LISREL confirmatory factor analyses of a multitrait-multimethod matrix were compared for 252 low-track and 588 high-track eleventh- and twelfth-grade students. The manner in which construct validity varies across groups is also discussed. (SLD)