Much of the argument about comparability of examination standards is at cross-purposes; contradictory positions are in fact often both defensible, but they are using the same words to mean different things. To clarify this, two broad conceptualisations of standards can be identified. One sees the standard in the observed phenomena of performance…

Robert Coe has claimed that three broad conceptions of comparability can be identified from the literature: performance, statistical and conventional. Each of these he rejected, in favour of a single, integrated conception which relies upon the notion of a "linking construct" and which he termed "construct comparability".…

Six distinguishable aspects of construct validity are discussed as they apply to performance assessment, emphasizing content, substantive, structural, generalizability, external, and consequential aspects. Taken together, these aspects provide a way to address validity questions in score interpretation and use. (SLD)

The construct validity of content standards is addressed in terms of their representative coverage of a construct domain and their alignment with the students' cognitive level of developing expertise in the subject matter. The construct validity of performance standards is addressed in terms of the extent to which they reflect increasing levels of…

The traditional concept of validity divides it into three separate types; content, criterion, and construct validities. This view is fragmented and incomplete, failing to take into account evidence of the value implications of score meaning as a basis for action and of the social consequences of score use. The new unified concept of validity…

In contrast to multiple choice, alternative modes of assessment afford varying degrees of openness in the allowable responses. Prominent among the alternatives is the assessment of performance, sometimes in its own right where the issue is the quality of the particular performance per se, but more often as a vehicle for the assessment of…

An integrative and critical review is provided of the guidance available for conducting validity inquiry in the context of performance assessment. Reviewed studies focus on philosophical underpinnings and practical guidelines for conducting validity inquiry. Sections describe the emerging consensus on validity inquiry, components of validity…

Authentic and direct assessment of performance and products are examined in light of contrasting functions and purposes with implications for validation, especially those of specialized validity criteria for performance assessment. The roles of positive and negative consequences of validation are underscored, along with the need for evidence of…

The implications for educational and employment testing of recent measurement, social, and policy issues are compared and contrasted. Changes are proposed relative to technical conceptualization of assessment, an increased focus on performance-based evaluation, and expanded expectations and uses of assessment. (SLD)

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

In recent years, many psychological constructs with associated measures have been proposed for educational research and the evaluation of educational programs. Among the most interesting and potentially useful are those reflecting motivational and volitional aspects of human behavior, the conative constructs. Among the conative constructs are…

This study was conducted in order to identify the major reading, cognitive, and linguistic skills that contribute to individual differences in performance on the reading portion of the Florida Comprehensive Assessment Test (FCAT) at third, seventh, and tenth grades. The authors were also interested in understanding the primary deficiencies in…

Science process skills are described as a set of broadly transferable abilities, appropriate to all of the science disciplines and reflective of the true behavior of scientists. While science process skills have gained wide acceptance as an integral part of the science curricula, the development of valid and reliable instruments to assess those…

One potential approach to the authentic assessment of what students know and can do in science is concept mapping. A concept map is a graph consisting of nodes representing concepts and labeled lines denoting the relation between a pair of nodes (concepts). The external concept map constructed by the student is interpreted as representing…

Standardized tests often produce results that are inaccurate, inconsistent, and biased against minority, female, and low-income students. Such tests shift control and authority into the hands of the unregulated testing industry and can undermine school achievement by narrowing the curriculum, frustrating teachers, and driving students out of…