Karabatsos compared the power of 36 person-fit statistics using receiver operating characteristics curves and found the "H[superscript T]" statistic to be the most powerful in identifying aberrant examinees. He found three statistics, "C", "MCI", and "U3", to be the next most powerful. These four statistics,…

Some universal behavioural screening processes require classroom teachers to complete a risk assessment measure on each student in their class, leading to a possible, but unexplored, problem: risk assessment scores may be influenced by the teacher completing the measure. The current study investigated whether teacher-reported risk assessment…

The search for necessary and sufficient causes of some outcome of interest, referred to as "configurational comparative research," has long been one of the main preoccupations of evaluation scholars and practitioners. However, only the last three decades have witnessed the evolution of a set of formal methods that are sufficiently…

Effective assessment practice requires clearly defining and operationalizing terminology. We illustrate the importance of this practice by focusing on academic "undermatching"--when students enroll in colleges that are less academically selective than those for which they are academically prepared. Undermatching has been viewed as a…

In a recent contribution to "Sociological Methods & Research," Baumgartner and Epple (B&E) employ Coincidence Analysis (CNA) to explain the outcome of the vote on the Swiss minaret initiative of 2009. Although the authors also present a substantive argument, their principal objective is to prove the superiority of CNA over…

Teacher effectiveness varies substantially, yet principals' evaluations of teachers often fail to differentiate performance among teachers. We offer new evidence on principals' subjective evaluations of their teachers' effectiveness using two sources of data from a large, urban district: principals' high-stakes personnel evaluations of teachers,…

Cost-effectiveness analysis is rarely used in education. When it is used, it often fails to meet methodological standards, especially with regard to cost measurement. Although there are occasional criticisms of these failings, we believe that it is useful to provide a listing of the more common concerns and how they might be addressed. Based upon…

Objective: This article describes the evaluation of permanency roundtables, an intervention to help youth in foster care achieve legal permanency and the challenges evaluators faced in finding and using appropriate comparison data. Method: In 2009, permanency roundtables were conducted for 496 children in Georgia, most of whom had spent extended…

Sustainable Development Goals call on Members States to "ensure inclusive and equitable quality education and promote lifelong learning opportunities for all" and sets a number of targets related to technical and vocational education and training (TVET). In order to collect input from the global TVET community, UNESCO-UNEVOC organized a…

Korea has used three different teacher evaluation systems since the 1960s: teacher performance rating, teacher performance-based pay and teacher evaluation for professional development. A number of studies have focused on an analysis of each evaluation system in terms of its advent, development, advantages and disadvantages, but these studies have…

Cognitive ability tests are widely used in organizations around the world because they have high predictive validity in selection contexts. Although these tests typically measure several subdomains, testing is usually carried out for a single subdomain at a time. This can be ineffective when the subdomains assessed are highly correlated. This…

Black and Hispanic students are undeniably underidentified as gifted and underrepresented in gifted education. The underrepresentation of the two largest groups of "minority" students is long-standing, dating several decades, and is a serious area of contention. Most debates focus on the efficacy of traditional intelligence tests with…

This report describes the implementation of professional development (PD) reforms and efforts to use teacher effectiveness (TE) data to inform PD through the third year of the initiative for all seven sites: Hillsborough County Public Schools (HCPS), Shelby County Schools (SCS, formerly Memphis City Schools), Pittsburgh Public Schools (PPS), and…

The Programme for International Student Assessment (PISA) was designed by the Organization for Economic Cooperation and Development (OECD) to evaluate the quality, equity, and efficiency of school systems around the world. Specifically, the PISA has assessed 15-year-old students' reading, mathematics, and science literacy on a 3-year cycle, since…

In high-stakes writing assessments, rater training in the use of a rating scale does not eliminate variability in grade attribution. This realisation has been accompanied by research that explores possible sources of rater variability, such as rater background or rating scale type. However, there has been little consideration thus far of…