Approaches to the evaluation of multitrait-multimethod data in which there are multiple indicators of each trait-method combination are explored. A first-order factor defined by multiple indicators is posited for each trait-method combination, and method and trait factors are posited as second-order factors. (SLD)

In practice, the inclusion of correlated residuals in latent-variable models is often regarded as a statistical sleight of hand, if not an outright form of cheating. Consequently, researchers have tended to allow only as many correlated residuals in their models as are needed to obtain a good fit to the data. The current article demonstrates that…

We report the development of the Assessment of Individual Motives-Questionnaire (AIM-Q), a new instrument based on an evolutionary psychology theory of human motivation. It provides multitrait-multimethod (MTMM) assessment of individual differences on 15 motive scales. A total heterogeneous sample of N = 1,251 participated in eight studies that…

Purpose: The purpose of this paper is to show that most small business owner-managers are technically competent in their area of business activity however they do not always have equal managerial competence. For example, deficiency in human resource management competence may lead to difficulties in attracting, retaining or leading staff. These…

A study was conducted comparing the feedback received from students about teaching obtained using different instruments. Twelve first- and second-year undergraduate modules were selected from seven different schools within a single university. Students studying each module were allocated to "questionnaire" and "comparator" groups. "Questionnaire"…

The authors report relations between entrance criteria and study success in a program for a master of science in business. Based on the admission criteria broadly used in European business schools and the findings of prior research, the present authors measured eight criteria for study success in the master's degree program. The authors applied…

This article proposes a multilevel modeling approach to study the general and specific attitudes formed in human learning behavior. Based on the premises of activity theory, it conceptualizes the unit of analysis for attitude measurement as a scalable and evolving activity system rather than a single action. Measurement issues related to this…

The validity of the Treatment Motivation Scales for outpatient offender treatment (TMS-F), a self-report questionnaire with scales for the motivation of patients to engage in the treatment and six cognitive and emotional determinants of this motivation, is evaluated in two studies. In Study 1 (N = 620), the "construct validity" of the…

Presents a quick distribution-free test that contributes evidence of construct validity from the Multitrait-Multimethod Matrix. The procedure is carried by reducing the heterotrait-heteromethod and heterotrait-monomethod triangles and the validity and reliability diagonals into a matrix of four levels. The null hypothesis states that the values…

Assessed two models for confirmatory factor analysis of multitrait-multimethod data through Monte Carlo simulation. The correlated traits-correlated methods (CTCM) and the correlated traits-correlated uniqueness (CTCU) models were compared. Results suggest that CTCU is a good alternative to CTCM in the typical multitrait-multimethod matrix, but…

The intersection of mixed methods and social justice has implications for the role of the researcher and choices of specific paradigmatic perspectives. The transformative paradigm with its associated philosophical assumptions provides a framework for addressing inequality and injustice in society using culturally competent, mixed methods…

A mixed methods study has the potential to produce knowledge that is unavailable to a qualitative study and a quantitative study undertaken independently. Any unique insight or "yield" from a mixed methods study may be difficult to assess in practice. However, given that integration of data or findings from different components of a…

This study investigated the convergent and discriminant validity of the high-stakes Florida Comprehensive Assessment Test (FCAT) in both reading and writing at grade levels 4, 8, and 10. The data from the 2006 FCAT administration were analyzed via traditional multitrait-multimethod (MTMM) analysis to identify the factor structure and structural…

Presents maximum-likelihood confirmatory factor analysis (CFA) as a means for interpreting complete and incomplete multitrait-multimethod designs. CFA was applied to four data sets representing four designs and to an artificial data set to demonstrate its use in test validation designs to assess discriminant, convergent, and construct validity.…

The criteria for assessing convergent and discriminant validity proposed by D. T. Campbell and D. W. Fiske (1959) are shown to be inadequate for either the additive or multiplicative structures of data in a multitrait-multimethod matrix. Model-specific criteria are more promising for assessing convergent and discriminant validity. (Author/SLD)