It is widely believed that subscores can give us more information about an examinee. Thus they can be useful in planning instructional and remedial efforts, or making vocational or academic placement decisions. However, past research has shown that subscores are often not as useful as hoped either because they do not have high reliability or…

Diagnostic classification models (DCMs) classify examinees based on the skills they have mastered given their test performance. This classification enables targeted feedback that can inform remedial instruction. Unfortunately, applications of DCMs have been criticized (e.g., no validity support). Generally, these evaluations have been brief and…

This study presents the reliability and validity of the Teacher Evaluation Experience Scale--Teacher Form (TEES-T), a multidimensional measure of educators' attitudes and beliefs about teacher evaluation. Confirmatory factor analyses of data from 583 teachers were conducted on the TEES-T hypothesized five-factor model, as well as on alternative…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

"Game-Based Assessments: A Promising Way to Create Idiographic Perspectives" (Adrienne Walker and George Englehard) comments on: "How Task Features Impact Evidence from Assessments Embedded in Simulations and Games" by Russell G. Almond, Yoon Jeon Kim, Gertrudes Velasquez, and Valerie J. Shute. Here, Walker and Englehard write…

The aspirational model resulted from the authors' secondary analysis of the Mother/Child (M/C) test block from the 2008 National Assessment of Educational Progress restricted data that examined the responses of the national sample of 8th-grade students (n = 1648). This test block presented no artmaking task and consisted of the same 13 questions…

Despite the current need for reliable and valid test instruments in different countries in order to monitor the sign language acquisition of deaf children, very few tests are commercially available that offer strong evidence for their psychometric properties. This mirrors the current state of affairs for many sign languages, where very little…

The temporal model of control (Frazier, Berman, & Steward, 2001) posits that different temporal aspects of control (i.e., past, present, and future) have markedly different relations with adjustment and need to be clearly distinguished from each other. The Perceived Control over Stressful Events Scale (PCOSES; Frazier, Keenan, et al., 2011)…

The purpose of this study was to develop and test the construct validity and reliability of a self-report measure of self-regulated practice behaviors for beginning and intermediate instrumentalists. A questionnaire was designed to assess the motive, method, behavior, time management, and social influences dimensions of the theoretical model of…

The Brigance Comprehensive Inventory of Basic Skills-II (CIBS-II)-Readiness form is a diagnostic battery intended for children aged 5 and 6 years. The CIBS-II-Readiness is a new version of the CIBS-Revised-Readiness and includes updated normative information on a larger representative sample in comparison to the CIBS-Revised-Readiness. Empirical…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

This study examined the construct validity of the Career Locus of Control Scale (CLCS) among diverse urban youth within the United States (N = 308). Confirmatory factor analyses verified two of the three models as acceptable fits. Two new models were also explored. Model 5 (Internality, Luck, and Non-Control), which was one of the new models, was…