The Safe Schools/Healthy Students (SS/HS) national evaluation seeks to assess both the implementation process and the results of the SS/HS initiative, exploring factors that have contributed to or detracted from grantee success. Each site is required to forge partnerships with representatives from education, mental health, juvenile justice, and…

Background/Context: The target of assessment validation is not an assessment but the use of an assessment for a purpose. Although the validation literature often provides examples of assessment purposes, comprehensive reviews of these purposes are rare. Additionally, assessment purposes posed for validation are generally described as discrete and…

This paper addresses the issue of the knowledge gap between evaluators and the entity being evaluated: the dilemma of the knowledge of professional evaluators vs. the in-depth knowledge of the evaluated subjects. In order to optimize evaluative outcomes, the author suggests an approach based on ideas borrowed from the science of cybernetics as a…

This article summarizes the research base on teacher effectiveness in physical education from a historical perspective and explores the implications of the recent emphasis on student performance and teacher observation systems to evaluate teachers for physical education. The problems and the potential positive effects of using student performance…

This paper examines the construct measured by automated essay scoring (AES) systems. AES systems measure features of the text structure, linguistic structure, and conventional print form of essays; as such, the systems primarily measure text production skills. In the current state-of-the-art, AES provide little direct evidence about such matters…

The present research examined the reliability of three types of divergent thinking tasks (unusual uses, instances, consequences/implications) and two types of subjective scoring (an average across all responses vs. the responses people chose as their top-two responses) within a latent variable framework, using the maximal-reliability "H"…

Despite the desire of employers to hire those with the critical-thinking and communication skills a general education (GE) program can offer, the value of GE programs is often questioned due to concerns about four-year graduation rates, perceived low immediate economic payoff, and a dearth of evidence to support their efficacy. This article…

The authors encourage those in the field of school psychology to consider the use of learning disabilities assessment practices in relation to specific American Psychological Association and National Association of School Psychologists ethical codes and in regard to the American Educational Research Association, American Psychological Association,…

In the United States, but not only here, the movement to evaluate teachers based on student test scores has received powerful political and parental support. The logic is simple. From one testing occasion to another students should show growth in their knowledge and skill. Similar types of students should show similar patterns of growth. Those…

One of the simplest indicators of teaching or course effectiveness is student ratings on one or more global items from the entire rating scale. That approach seems intuitively sound and easy to use. Global items have even been recommended by a few researchers to get a quick-read, at-a-glance summary for summative decisions about faculty. The…

Rubric means red ochre--red earth--as in Bryce Canyon and Sedona. Red headers were used in medieval manuscripts as section or chapter markers, and you can bet that the Whore of Babylon got herself some fancy rubrics over the years. Through most of its history, the word has been attached to religious texts and liturgy; rubrics were used as…

Principals and teachers do not use large-scale assessment results because the lack of distinct and reliable subtests prevents identifying strengths and weaknesses of students and instruction, the results arrive too late to be used, and principals and teachers need assistance to use the results to improve instruction so as to improve student…

Studying pervasive games is inherently difficult and different from studying computer or board games. This article builds upon the experiences of staging and studying several playful pervasive technology prototypes. It discusses the challenges and pitfalls of evaluating pervasive game prototypes and charts methods that have proven useful in…

Despite considerable interest in the topic of instructional quality in research as well as practice, little is known about the quality of its assessment. Using generalizability analysis as well as content analysis, the present study investigates how reliably and validly instructional quality is measured by observer ratings. Twelve trained raters…

This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…