What is "fairness" in the context of educational assessment? I apply this question to a number of contemporary educational assessment practices and policies. My approach to philosophy of education owes much to Wittgenstein. A commentary set apart from the main body of the paper focuses on my style of philosophising. Wittgenstein teaches us to…

In 2002, voters in Florida approved a constitutional amendment limiting class sizes in public schools to 18 students in the elementary grades, 22 students in middle grades, and 25 in high school grades. Analyzing statewide achievement data for school districts from 2004-2006 and for schools in 2007, this study purports to find that "mandated…

This paper is a reflection on practice. It begins by briefly describing an evaluation of an externally-funded education programme in Kosovo (a new country in south-east Europe). The programme was managed by Save the Children in Kosovo and aimed to develop and promote models of inclusive education through three strands of activity. The first of…

There is already a growing literature on assessment and an emergent scholarship that people in the scholarship of teaching and learning (SoTL) community need both to promote and to build on if assessment is to be a scholarly activity. Awareness alone, however, is unlikely to be enough. The poor practice highlighted in this article is not simply…

Student evaluations should "be ethical, fair, useful, feasible, and accurate" [JCSEE (2003). "The student evaluation standards." Arlen Gullickson, Chair. Thousand Oaks, CA: Corwin]. This study focuses on defining ethical behavior and examining educators' ethical judgments in relation to assessment. It describes the results from…

Rapidly declining response rates and the associated threat of nonresponse bias call into question the validity of data obtained through telephone surveys, a tool often used in evaluation. This article explores changes in nonresponse bias over time by examining three data points (1991, 1996, and 2002) from an annual household telephone survey…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

The middle school years are among the most formidable, as students transition from youth to adulthood. Self-esteem, consequently, is a significant attribute in developing the strong character necessary to successfully navigate middle school. Because a student's grades can influence how the student feels about his or her ability to learn, teachers…

Drug studies are often cited as the best exemplars of evaluation design. However, many of these studies are seriously biased in favor of positive findings for the drugs evaluated, even to the point where dangerous effects are hidden. In spite of using randomized designs and double blinding, drug companies have found ways of producing the results…

The Case of Top Beginnings and the Missing Child Outcomes is a fictionalized case study of a set of evaluation challenges faced in evaluating comprehensive initiatives that are seeking to build systems. In this case, the issue is a multistate foundation-funded early learning system building initiative that has to date primarily employed a case…

The term "intervention validity" refers to the extent to which assessment results can be used to guide the selection of interventions and evaluation of outcomes. In this article, the authors review the defining attributes of rating scales that distinguish them from other assessment tools, assumptions regarding the use of rating scales to…

A central commitment for professional development schools (PDSs) is to link preservice teacher preparation and in-service teacher professional development with improved learning outcomes for pupils. PDSs are expected to improve student achievement in two primary ways: (1) by enriching and intensifying the learning environment through professional…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

In this article, we introduce a person-fit statistic called the hierarchy consistency index (HCI) to help detect misfitting item response vectors for tests developed and analyzed based on a cognitive model. The HCI ranges from -1.0 to 1.0, with values close to -1.0 indicating that students respond unexpectedly or differently from the responses…