Most states have developed or revised school accountability systems in response to the Every Student Succeeds Act (ESSA). While these systems include multiple indicators, to many stakeholders the outcome of central interest is the overall rating or classification produced for each school. These ratings are often used to identify schools that merit…

This report summarizes and further develops ideas discussed at a national working session held on May 23, 2014, to examine issues and options associated with initially classifying English learners (ELs). It is the third in a series of guidance papers intended to support states in large-scale assessment consortia that are expected to move toward a…

College rankings create much talk and discussion in the higher education arena. This love/hate relationship has not necessarily resulted in better rankings, but rather, more rankings. This paper looks at some of the measures and pitfalls of the current rankings systems, and proposes areas for improvement through a better focus on teaching and…

Purpose: The purpose of this paper is to investigate the potential of already existing skills and competence ontologies to benefit European transparency tools and especially the implementation of the European Qualification Framework. Furthermore, it asks whether any of them could serve as a starting point to develop an International Standard…

University league tables in their present form have been around for two decades. One of their objectives has been to help would-be university students (and their parents) make an informed choice of university and course. In the United Kingdom, historically, they have taken the form of a numerical hierarchy topped (predictably) by Oxford and…

"Classification" and "ranking" are tools for comparing colleges and universities, albeit for different purposes. Although "classification" focuses on identifying similarities rather than ordering institutions, it is closely intertwined with "ranking", whether directly through its content, structure, and…

This paper describes a practical method for identifying and communicating expectations of student performance in the classroom. The method has been used at McREL for clients who require a systematic approach to setting performance expectations and communicating these to their constituents. This document in organized in the following sections: (1)…

Some of the different approaches to standard setting are discussed. Brief comments and references are offered concerning strategies that rely primarily on the use of expert judgment. Controversy surrounds methods that use expert judges, as well as those using test groups to set scores empirically. A minimax procedure developed by H. Huynh, an…

We look at some of the theoretical and methodological issues underlying international university ranking systems and, in particular, their conceptual connection with the idea of excellence. We then turn to a critical examination of the two best-known international university ranking systems--the "Times Higher Education Supplement (THES)" World…

The results of classifying test items on the basis of their Mantel-Haenszel (MH) alpha estimates were compared to the results of classifying these items using an item response theory (IRT) based procedure involving the comparison of item difficulties in the interest of identifying the alpha value that maximized the decision concordance between the…

In order to evaluate standard setting procedures, apart from the more commonly applied approach of simply comparing the derived standards or failure rates across various techniques, this study investigated the errors of classification associated with the contrasting groups procedures. Monte Carlo simulations were employed to produce…

European structures of qualification levels were examined through a review of reports on recent developments in Germany, Spain, France, the Netherlands, and the United Kingdom. The examination focused on the following topics: the scope of the national frameworks; the definition of standards and qualifications; the definition of levels in…

Recent trends and developments related to the structures of qualification levels in Germany, Spain, France, the Netherlands, and the United Kingdom were examined in a quasi-experimental study that was part of a more comprehensive study on the same topic. The study focused on standards, qualifications, and classifications at the tertiary level of…

This document contains reports on the structures of qualification levels in Germany, Spain, France, the Netherlands, and the United Kingdom that were commissioned during a study to identify trends and developments in the European Union related to national certification frameworks. Each country report examines the following topics: the history of…