Cognitive diagnostic assessment is known for its capacity to provide detailed feedback to test-takers, which can inform instruction and guide learning. Besides this core strength of the assessment approach, the measurement procedure also works as a construct validation method in itself. Previous studies do not call attention to this aspect of…

Although specific learning disabilities (SLD) represent the largest category for which school-age children receive special education services, the science and practice of SLD identification continues to evade consensus. Our goal is to bring together trainers and researchers with different perspectives on SLD identification to help spur a move…

This study aimed to evaluate the tenability of the proposed scoring/interpretive structure for the Woodcock-Johnson IV Test of Cognitive Abilities (WJ IV COG) Standard Battery configuration of subtests using confirmatory factor analysis (CFA) at school age. Results indicated that a three-factor hierarchical model, consistent with the CHC theory…

Measurement errors attributable to cultural issues are complex and challenging for educational assessments. We need assessment tests sensitive to the cultural heterogeneity of populations, and psychometric methods appropriate to address fairness and equity concerns. Built on the research of culturally responsive assessment, this dissertation…

The current study examined the incremental validity of the clinical clusters from the Woodcock-Johnson III Tests of Cognitive Abilities (WJ-III COG) for predicting scores on the Woodcock-Johnson III Tests of Achievement (WJ-III ACH). All participants were children and adolescents (N = 4,722) drawn from the nationally representative WJ-III…

The use of the nomination stage as the first step in the identification process is pervasive across the field of gifted education. In many cases, nominations are used to limit the number of students who will need to be evaluated using costly and time-consuming assessments for the purpose of gifted program identification and placement. This study…

In this study, we reviewed 76 journal articles on employing drawing assessment as a research tool in science education. Findings from the systematic review suggest four justifications for using drawing as a type of research tool, including assessment via drawing as (a) an alternative method considering young participants' verbal or writing…

Cognitive testing has become routine for well-designed surveys. However, the protocols for cognitive testing vary widely, and observers have been concerned that analysis of the results is not systematic, that results are not replicable, and that the bases for conclusions are not transparent. To address some of those concerns, in this study the…

The increasing diversity of the U.S. population has resulted in increased concerns about the psychological assessment of students from culturally and linguistically diverse backgrounds. To date, little empirical research supports recommendations in test selection and interpretation, such as those presented in the Culture-Language Interpretative…

The Woodcock-Johnson Tests of Cognitive Ability Third Edition is developed using the Cattell-Horn-Carroll (CHC) measurement-theory test design as the instrument's theoretical blueprint. The instrument provides users with cognitive scores based on the Cognitive Performance Model (CPM); however, the CPM is not a part of CHC theory. Within the…

This article introduces procedures for the computation and asymptotic statistical inference for classification consistency and accuracy indices specifically designed for cognitive diagnostic assessments. The new classification indices can be used as important indicators of the reliability and validity of classification results produced by…

Critical thinking is one of the most important skills deemed necessary for college graduates to become effective contributors in the global workforce. The first part of this article provides a comprehensive review of its definitions by major frameworks in higher education and the workforce, existing assessments and their psychometric qualities,…

Learning progressions represent a set of skills or pieces of knowledge ordered sequentially from least to most complex. This sequence can guide instruction as well as assessment content. This paper describes several useful methods for validating learning progressions including validating the relationship between the progression and student…

Despite widespread use of the Mullen Scales of Early Learning (MSEL; E. M. Mullen, 1995) as a cognitive test for children with autism spectrum disorders and other developmental disabilities, the instrument has not been independently validated for use in these populations. Convergent validity of the MSEL and the Differential Ability Scales (DAS; C.…

The goal of this study was to investigate the usefulness of person-fit analysis in validating student score inferences in a cognitive diagnostic assessment. In this study, a two-stage procedure was used to evaluate person fit for a diagnostic test in the domain of statistical hypothesis testing. In the first stage, the person-fit statistic, the…