Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

This technical report provides an overview of the New York State Alternate Assessment (NYSAA), including a description of the purpose of the NYSAA, the processes utilized to develop and implement the NYSAA program, and Stakeholder involvement in those processes. The purpose of this report is to document the technical aspects of the 2013-14 NYSAA.…

This commentary discusses three essential themes in performance assessment and its scoring. First, scores should mean something. Second, performance scores should permit fair and meaningful comparisons. Third, validity-reducing errors should be minimal. Increased attention to performance assessment may overcome these problems. (SLD)

This paper reports the results of an analysis of the relationship between scorer behaviors and score variability. Thirty-six essay scorers were interviewed and asked to perform a think-aloud task as they scored 24 essays. Each comment made by a scorer was coded according to its content focus (i.e. appearance, assignment, mechanics, communication,…

The Ability Explorer (AE) is a newly developed self-report inventory of abilities that is appropriate for group or individual administration. There are machine-scorable and hand-scorable versions of the test, and there are two levels. Level 1 is for students from junior high to high school, and Level 2 is for high school students and adults.…

A new assessment conception is described that integrates constructed-response testing, artificial intelligence, and model-based measurement. The conception incorporates complex constructed-response items for their potential to increase the validity, instructional utility, and credibility of standardized tests. Artificial intelligence methods are…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

The Riley Inventory of Basic Learning Skills (RIBLS) is a group test that assesses 12 learning process skills in 5 general modalities (visual, auditory, verbal, kinesthetic, and abstract). The RIBLS is intended for administration to groups or individuals from age 6 to adulthood in two levels: a lower level for those who cannot read or are under…

The purpose of the Graduate Record Examinations (GRE) figural-response project was to design a prototype computer assessment system for delivering and scoring figural-response items in the domain of cell and molecular biology and to begin to investigate properties of the item format. This report describes progress to date in an effort that is…

Portfolios can demonstrate student mastery of material and their work with concepts and content, as well as their ability to link material with other knowledge. Portfolios can closely relate what students learn to what teachers believe they teach. The decision to use portfolios requires planning, professional development, decision making, and a…

The Work Keys (trademark) system of the American College Testing program has combined assessments of listening and writing into a single test administration. The Listening and Writing assessment uses independent scorings of the examinee's written responses to audiotaped prompts to assess both listening and writing skills separately. This paper…

These guidelines are provided to offer guidance to district and state policy makers and assessment directors concerning some issues of managing the development, administration, and use of performance assessments in large scale assessment programs. The term "performance assessment" is used for assessments that go beyond paper-and-pencil,…

This book reviews the assessment movement, from the history of testing to the practical considerations of enhancing classroom experiences for teachers and students. It explores making time for assessment, tailoring assessment to desired outcomes, and scoring and evaluating student performance. The chapters are: (1) "Where We've Been: Standardized…

Portfolios are the centerpiece of Vermont's statewide assessment program in mathematics. Portfolio scores in the first two years were not reliable enough to permit the reporting of student-level results, but increasing the number of readers or the number of portfolio pieces is not operationally feasible. (SLD)