A graphical method is presented for assessing the state of identifiability of the parameters in a linear structural equation model based on the associated directed graph. We do not restrict attention to recursive models. In the recent literature, methods based on graphical models have been presented as a useful tool for assessing the state of…

Most model fit analyses in cognitive diagnosis assume that a Q matrix is correct after it has been constructed, without verifying its appropriateness. Consequently, any model misfit attributable to the Q matrix cannot be addressed and remedied. To address this concern, this paper proposes an empirically based method of validating a Q matrix used…

The purpose of this paper is to offer an analytic perspective to policy makers and educational practitioners regarding how to use longitudinal achievement data to evaluate schools. The authors further discuss the potential practical applications of their models for superintendents, researchers, and policy makers. The premise of the study is that…

The purpose of this study was to investigate the application of the parallel analysis (PA) method for choosing the number of factors in component analysis for situations in which data are dichotomous or ordinal. Although polychoric correlations are sometimes used as input for component analyses, the random data matrices generated for use in PA…

Numerous procedures have been suggested for determining the number of factors to retain in factor analysis. However, previous studies have focused on comparing methods using normal data sets. This study had two phases. The first phase explored the Kaiser method, Scree test, Bartlett's chi-square test, Minimum Average Partial (1976&2000),…

The purpose of this study was to examine the impact of misspecifying a growth mixture model (GMM) by assuming that Level-1 residual variances are constant across classes, when they do, in fact, vary in each subpopulation. Misspecification produced bias in the within-class growth trajectories and variance components, and estimates were…

Figural matrix items are a popular task type for assessing general intelligence (Spearman's g). Items of this kind can be constructed rationally, allowing the implementation of computerized generation algorithms. In this study, the influence of different task parameters on the degree of difficulty in matrix items was investigated. A sample of N =…

Preparing early childhood education (ECE) and early childhood special education (ECSE) professionals to work with young children with and without disabilities entails the acquisition of content, its application, and opportunities for reflection. This article describes a component of an ECSE assessment course focusing on the logistics and process…

When conducting an exploratory factor analysis, the decision regarding the number of factors to retain following factor extraction is one that the researcher should consider very carefully, as the decision can have a dramatic effect on results. Although there are numerous strategies that can and should be utilized when making this decision,…

Normal theory maximum likelihood (ML) is by far the most popular estimation and testing method used in structural equation modeling (SEM), and it is the default in most SEM programs. Even though this approach assumes multivariate normality of the data, its use can be justified on the grounds that it is fairly robust to the violations of the…

In the School of Education at the University of Adelaide, the use of oral evidence is increasingly common as students engage with reflective practices now dominant in teacher-education programs. These experiences offer both a dynamic perspective and a challenge to academic assessors and raise three questions, each of which are addressed in this…

The originally proposed multivariate meta-analysis approach for correlation matrices--analyze Pearson correlations, with each study's observed correlations replacing their population counterparts in its conditional-covariance matrix--performs poorly. Two refinements are considered: Analyze Fisher Z-transformed correlations, and substitute better…

Develops a heuristic device called the Formative Evaluation Outcomes Matrix that systematizes the data from three commonly used formative evaluation instruments for the purpose of diagnosing faults in products of the design process. (Author)

Criteria sets are a necessary step in the systematic development of evaluation in education. Evaluation results from the combination of criteria and evidence. There is a need to develop explicit tools for evaluating criteria, similar to those used in evaluating evidence. The formulation of such criteria depends on distinguishing between terms…

The criteria for assessing convergent and discriminant validity proposed by D. T. Campbell and D. W. Fiske (1959) are shown to be inadequate for either the additive or multiplicative structures of data in a multitrait-multimethod matrix. Model-specific criteria are more promising for assessing convergent and discriminant validity. (Author/SLD)