This paper describes how a state education system in Australia introduced standards-referenced assessments into its large-scale, high-stakes, curriculum-based examinations in a way that enables comparison of performance across time even though the examinations are different each year. It describes the multi-stage modified Angoff standard-setting…

The purpose of this article is to describe the process and development of English Language Proficiency (ELP) standards and assessment in Ohio and to discuss issues related to alignment. The article addresses the importance of alignment among standards, instruction, and assessment, as well as the effect of alignment on students' academic…

In recent years, procedures have been established in Flanders for "Prior Learning Assessment" (PLA) outside the formal learning circuit, of which the portfolio is a regular component. In order to maximize the possibilities of acknowledgement of prior learning assessment, the Flemish government is looking for a set of common criteria and…

In the criterion-based clinical assessment context, and more broadly, examination resits continue to present an ongoing dilemma to educators. The number of students involved is generally a small percentage of the cohort, but it is precisely with these students that institutions bear a heavy responsibility in ensuring they reach a sufficiently high…

University league tables in their present form have been around for two decades. One of their objectives has been to help would-be university students (and their parents) make an informed choice of university and course. In the United Kingdom, historically, they have taken the form of a numerical hierarchy topped (predictably) by Oxford and…

In four articles adapted from the Educational Testing Service (ETS) Research Report Series, Issue 2 of ETS Research Spotlight provides a small taste of the range of assessment-related research capabilities of the ETS Research and Development Division. Those articles cover assessment-related research aimed at developing models of student learning,…

The Collegiate Learning Assessment (CLA) is a measure of how much students' critical thinking improves after attending college or university. This report illustrates how institutions can set their own standards on the CLA using a method that is appropriate for the CLA's unique characteristics. The authors examined evidence of reliability and…

The National Assessment Governing Board used a new method to set achievement level standards on the 2005 Grade 12 NAEP Math test. In this article, we summarize our independent evaluation of the process used to set these standards. The evaluation data included observations of the standard-setting meeting, observations of advisory committee meetings…

"Classification" and "ranking" are tools for comparing colleges and universities, albeit for different purposes. Although "classification" focuses on identifying similarities rather than ordering institutions, it is closely intertwined with "ranking", whether directly through its content, structure, and…

Cumulative Grade Point Average (CGPA) is a measure that is used to display the achievement of college students in Ethiopia. It also serves as a key yardstick in career and scholarship assessment. In recent time there has been a rapid massification of higher educational institutions (HEIs). Many academics believe that the expansion has increased a…

Absolute standard setting procedures are recommended for assessment in medical education. Absolute, test-centred standard setting procedures were introduced for written assessments in the Liverpool MBChB in 2001. The modified Angoff and Ebel methods have been used for short answer question-based and extended matching question-based papers,…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

This report documents a standard-setting study to determine recommended minimum scores (cut scores) needed on the Core and Advanced iSkills[TM] assessments for examinees to be considered at a foundational level of ICT literacy skill. Two foundational levels--one for each iSkills assessment--had been specified previously by the National ICT…

A new judgemental method of equating raw scores on two tests, based on rank-ordering scripts from both tests, has been developed by Bramley. The rank-ordering method has potential application as a judgemental standard-maintaining mechanism, because given a mark on one test (e.g. the A grade boundary mark), the equivalent mark (i.e. at the same…

This article presents quantitative evidence that shows that the introduction of a research assessment scheme similar to the proposed Research Quality Framework (RQF) is likely to exacerbate gender inequity in the Australian university sector. It contributes new measures of gender differences in the publications records of Australian academics. It…