Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching…

We describe the summative assessment component within a K-12 assessment program and our development of a validity argument to support its claims with respect to intended uses and interpretations. First, we describe the "Winsight"® assessment program theory of action, a logic model elucidating mechanisms for how use of the assessment…

In this article we rethink validation within the complex contexts of high-stakes assessment. We begin by considering the utility of existing models for validation and argue that these models tend to overlook some of the complexities inherent to assessment use, including the multiple interpretations of assessment purposes and the potential…

The vast majority of measures have, at their core, a purpose of personal and social change. If test developers and users want measures to have personal and social consequences and impact, then it is critical to consider the consequences and side effects of measurement in the validation process itself. The consequential basis of test interpretation…

The Assessment Clearinghouse of the Memphis (Tennessee) City Public Schools is a collection of performance-based instructional tasks that have been designed to address specific content standards at specific grade levels. The tasks consist of a complete set of instructional and assessment activities for immediate classroom use. They also provide a…

Links the literatures on human abilities and expertise, suggesting that human abilities are a form of developing expertise. Discusses the role of tests in a scheme that regards abilities as developing expertise and presents a model that implies a shift toward practice grounded in the development of knowledge-based expertise in all children.…

Educational measurement is presented as integral to the process of entering into and guiding conversations in which teachers and students participate. A measurement model patterned on the playful, interactive back-and-forth motion of conversation could aid in overcoming problems in teacher-student interactions. According to H. G. Gadamer,…

Standard setting is a fairly widespread activity in educational and psychological measurement, but there is no formal psychometric theory to guide the development of standard setting methodology. This paper presents a conceptual framework for such a psychometric theory and uses the conceptual framework to analyze a number of methods for setting…

A new assessment conception is described that integrates constructed-response testing, artificial intelligence, and model-based measurement. The conception incorporates complex constructed-response items for their potential to increase the validity, instructional utility, and credibility of standardized tests. Artificial intelligence methods are…

Diagnostic assessment combining cognitive science and psychometrics, cognitively diagnostic assessment (CDA), is characterized in terms of the intended use of the assessment and methods of developing and evaluating assessments. Societal trends motivating the development of CDA and efforts to develop a five-step methodology for CDA are outlined.…

The usefulness of traditional concepts of validity and reliability, developed for large-scale assessments, for the classroom context is explored. Alternate frameworks that situate these constructs in teachers' work in classrooms are presented, and their use in an assessment course for preservice teachers is described. (SLD)

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

The Dallas Independent School District (DISD) is rapidly progressing from the position of having an assessment program that does not work to the position of having an assessment program that does work. The perception that assessment is separate from instruction has changed to a view of assessment as part of a four-stage model including planning,…

Assessment systems to measure high educational standards emerged as the major theme at the 1996 conference of the National Center for Research on Evaluation, Standards, and Student Testing (CRESST), "Moving Up to Complex Assessment." This feature article, providing a summation of the proceedings of the conference, reports that the…

Proposed an accountably model that addresses the challenges of allowing school districts to choose the specific strategies they use to measure student performance and evaluated this model using data from multiple sources for all school districts in Florida. Findings identify three strategies that would be useful for this type of accountability…