One of the central components of cognitive diagnostic assessment is the Q-matrix, which is an essential loading indicator matrix and is typically constructed by subject matter experts. Nonetheless, to a large extent, the construction of Q-matrix remains a subjective process and might lead to misspecifications. Many researchers have recognized the…

A Q-matrix is a binary matrix that defines the relationship between items and latent variables and is widely used in diagnostic classification models (DCMs), and can also be adopted in multidimensional item response theory (MIRT) models. The construction process of the Q-matrix is typically carried out by experts in the subject area of the items…

A Q-matrix is a binary matrix that defines the relationship between items and latent variables and is widely used in diagnostic classification models (DCMs), and can also be adopted in multidimensional item response theory (MIRT) models. The construction process of the Q-matrix is typically carried out by experts in the subject area of the items…

Systematic reviews and meta-analyses are essential for drawing conclusions regarding etiologic associations between exposures or interventions and health outcomes. Observational studies comprise a substantive source of the evidence base. One major threat to their validity is residual confounding, which may occur when component studies adjust for…

Cognitive diagnosis models (CDMs) are latent class multidimensional statistical models that help classify people accurately by using a set of discrete latent variables, commonly referred to as attributes. These models require a Q-matrix that indicates the attributes involved in each item. A potential problem is that the Q-matrix construction…

Large-scale assessments are generally designed for summative purposes to compare achievement among participating countries. However, these nondiagnostic assessments have also been adapted in the context of cognitive diagnostic assessment for diagnostic purposes. Following the large amount of investments in these assessments, it would be…

Intending to improve the teaching and learning of the notion of mathematical proof this study seeks to uncover the kinds of flaws in postgraduate mathematics education student teachers. Twenty-three student teachers responded to a proof task involving the concepts of transposition and multiplication of matrices. Analytic induction strategy that…

In recent years, substantial improvements were obtained in the effectiveness of data driven algorithms to validate the mapping of items to skills, or the Q-matrix. In the current study we use ensemble algorithms on top of existing Q-matrix refinement algorithms to improve their performance. We combine the boosting technique with a decision tree.…

Initiatives to increase leadership accountability coupled with efforts to promote data-driven leadership have led to widespread adoption of instruments to assess school leaders. In this paper we present a decision matrix that practitioners and researchers can use to facilitate instrument selection. Our decision matrix focuses on the psychometric…

Cognitive diagnostic analyses have been advocated as methods that allow an assessment to function as a formative assessment to inform instruction. To use this approach, it is necessary to first identify the skills required for each item in the test, known as a Q-matrix. However, because the construct being tested and the underlying cognitive…

Developed a procedure for overcoming the computational and technological limitations of analyzing data with missing observations by extracting data from a sparsely filled data matrix into analyzable smaller subsets of data. Demonstrated the validity of this subdividing method using a Monte Carlo simulation. (SLD)

The purpose of this paper is to examine the validity of regression estimates when skewed dichotomous scales are used as independent variables. When Pearson product-moment correlations are used to measure zero-order associations involving dichotomous variables, the resulting coefficients underestimate the true associations. As a result, using…

Order analysis is a measurement technique for the quantitative and generalizable description of complex structures. Relations between the manifest elements of a data matrix and its underlying latent entities and attributes are considered in terms of magnitudes as basic scale units. Magnitude is conceptualized as a difference relation, translated…

A stepwise canonical procedure, including two selection indices for variable deletion and a rule for stopping the iterative procedure, was derived as a method of selecting core variables from predictors and criteria. The procedure was applied to simulated data varying in the degree of built in structures in population correlation matrices, number…

Results of using multimethod factor analysis and exploratory factor analysis for the analysis of three multitrait-multimethod matrices are compared. Results suggest that the two methods can give quite different impressions of discriminant validity. In the examples considered, the former procedure tends to support discrimination while the latter…