The Scylla and Charybdis in this discussion of teacher evaluation are standardized achievement test data on the one hand, and classroom observational systems on the other. These are the two most common methods used to judge teachers' competency. Both have serious flaws: the former primarily with validity, the latter primarily with reliability. At…

The present study investigated a direct assessment of behavioral self-regulation (the Head-Toes-Knees-Shoulders; HTKS) and its contribution to early academic achievement among young children in Germany and Iceland. The authors examined the psychometric properties and construct validity of the HTKS, investigated gender differences in young…

The edTPA, a nationally available performance assessment for teacher candidates, has recently been developed and implemented in teacher education programs across the United States. Advocates make arguments for the need for such an assessment while critics of standardized performance assessments point out the dangers of standardization. This…

Analysis of children's spoken narratives represents a potentially informative approach to language assessment within early childhood settings. Yet, narrative assessment is not readily amenable to at-scale use given the time needed to collect, transcribe, and analyze a child's narrative sample and the lack of consensus regarding what aspects of…

Communication skills training is an accepted part of undergraduate medical programs nowadays. In addition to learning experiences its importance should be emphasised by performance-based assessment. As detailed checklists have been shown to be not well suited for the assessment of communication skills for different reasons, this study aimed to…

This paper draws on semi-structured interview data and participant observations of senior secondary Physical Education (PE) teachers and students at two school sites across 20 weeks of the school year. The data indicated that the teachers in this study made progressive judgements about students' level of achievement across each unit of work…

Behavioral aspects of self-regulation, including controlling and directing actions, paying attention, and remembering instructions, are critical for successful functioning in preschool and elementary school. In recent years, several direct assessments of these skills have appeared, but few studies provide complete psychometric data and many are…

This review of methods for validating writing assessments was conceptualized within a framework suggested by S. Messick (1989) that included five operational components of construct validation: (1) content representativeness; (2) structural fidelity; (3) nomological validity; (4) criterion-related validity; and (5) nomothetic span. (SLD)

The construct validity of content standards is addressed in terms of their representative coverage of a construct domain and their alignment with the students' cognitive level of developing expertise in the subject matter. The construct validity of performance standards is addressed in terms of the extent to which they reflect increasing levels of…

The traditional concept of validity divides it into three separate types; content, criterion, and construct validities. This view is fragmented and incomplete, failing to take into account evidence of the value implications of score meaning as a basis for action and of the social consequences of score use. The new unified concept of validity…

In contrast to multiple choice, alternative modes of assessment afford varying degrees of openness in the allowable responses. Prominent among the alternatives is the assessment of performance, sometimes in its own right where the issue is the quality of the particular performance per se, but more often as a vehicle for the assessment of…

An integrative and critical review is provided of the guidance available for conducting validity inquiry in the context of performance assessment. Reviewed studies focus on philosophical underpinnings and practical guidelines for conducting validity inquiry. Sections describe the emerging consensus on validity inquiry, components of validity…

Authentic and direct assessment of performance and products are examined in light of contrasting functions and purposes with implications for validation, especially those of specialized validity criteria for performance assessment. The roles of positive and negative consequences of validation are underscored, along with the need for evidence of…

The concept of "washback," especially prominent in the field of applied linguistics, refers to the extent to which a test influences teachers and learners to do things they would not otherwise necessarily do. Some writers invoke the notion of washback validity, holding that a test's validity should be gauged by the degree to which it has…

The implications for educational and employment testing of recent measurement, social, and policy issues are compared and contrasted. Changes are proposed relative to technical conceptualization of assessment, an increased focus on performance-based evaluation, and expanded expectations and uses of assessment. (SLD)