We used multitrait-multimethod (MTMM) modeling to examine general factors of psychopathology in three samples of youth (Ns = 2119, 303, 592) for whom three informants reported on the youth's psychopathology (e.g., child, parent, teacher). Empirical support for the "p"-factor diminished in multi-informant models compared with…

Multimethod data analysis is a complex procedure that is often used to examine the degree to which different measures of the same construct converge in the assessment of this construct. Several authors have called for a greater understanding of the definition and meaning of method effects in different models for multimethod data. In this article,…

In 1959, Campbell and Fiske introduced the use of multitrait-multimethod (MTMM) matrices in psychology, and for the past 4 decades confirmatory factor analysis (CFA) has commonly been used to analyze MTMM data. However, researchers do not always fit CFA models when MTMM data are available; when CFA modeling is used, multiple models are available…

Multiple evaluation methods (MEMs) can cause an inferential challenge, although there are strategies to strengthen inferences. Practical and theoretical issues involved in the use by social scientists of MEMs, three potential problems in drawing inferences from MEMs, and short- and long-term strategies for alleviating these problems are outlined.…

Common approaches to examining the relationship between multitrait-multimethod (MTMM) data and variables outside the MTMM data are compared: averaging various means of each trait and estimating LISREL computer program models, and estimating only relationships between MTMM traits and the outside variables. Problems of correlational bias are…

Studied the convergent and discriminant validity of multiple measures of perceived competence and obtained 12 separate multitrait-multimethod (MTMM) data sets for 1,228 children in grades 3 through 8. Examined the bias inherent in appraisals of children's competence and estimated manifest and latent variable mean differences between boys and girls…

Quality assurance and evaluation research, like other fields of social research and its application, are confronted with a series of problems. In the present paper, I want first to give a list of such problems, although necessarily incomplete. It is then claimed that while there is no "perfect" solution to these problems, critical multiplism may…

A beverage-server intervention project at two West Coast Navy bases that attempted to reduce levels of alcoholic intoxication via policy changes and server training is described. Data obtained via interviews and structured observations of 1,511 club customers indicate methodological bias and self-selection effects. Bias adjustments were performed…