Non-certified personnel in K-12 education in Pennsylvania represent approximately one-third of all public education employees. Although there has been large-scale reform in the evaluation of certified staff, the non-certified population may not be evaluated at all. The lack of consistency in evaluating this large segment of K-12 education…

In this study, the cut-off scores obtained from the Angoff, Angoff Y/N, Nedelsky and Ebel standard methods were compared with the 50 T score and the current cut-off score in various aspects. Data were collected from 448 students who took Module B1+ English Exit Exam IV and 14 experts. It was seen that while the Nedelsky method gave the lowest…

The aim of this study was to compare, by simulation, the accuracy of mapping a cut-score from one test to another by expert judgement (using the Angoff method) versus the accuracy with a small-sample equating method (chained linear equating). As expected, the standard-setting method resulted in more accurate equating when we assumed a higher level…

This article uses discourse analysis techniques associated with Foucauldian archaeology to examine the two international charters developed by the International Geographical Union Commission on Geographical Education (IGU-CGE), the original one in 1992 and the revised version endorsed in 2016 at the Beijing conference. The examination considers…

One common modification to the Angoff standard-setting method is to have panelists round their ratings to the nearest 0.05 or 0.10 instead of 0.01. Several reasons have been offered as to why it may make sense to have panelists round their ratings to the nearest 0.05 or 0.10. In this article, we examine one reason that has been suggested, which is…

Placing non-native speakers of English into appropriate classes involves mapping placement test scores onto proficiency levels based on predetermined cut scores. However, studies on how to set boundaries for different levels of proficiency have been lacking in the language testing literature. A top-down approach to standard setting in which a…

The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is…

The purpose of the present study was to extend past work with the Angoff method for setting standards by examining judgments at the judge level rather than the panel level. The focus was on investigating the relationship between observed Angoff standard setting judgments and empirical conditional probabilities. This relationship has been used as a…

(Purpose) The purpose of our study was to assess the need for an external searchable resource to be used in conjunction with the American Board of Family Medicine's (ABFM) Maintenance of Certification for Family Physicians (MC-FP) Examination, discuss the philosophical question of whether an ESR should be allowed on the examination, and outline…

This study investigated the extent to which the performance data format impacted data use in Angoff standard setting exercises. Judges from two standard settings (a total of five panels) were randomly assigned to one of two groups. The full-data group received two types of data: (1) the proportion of examinees selecting each option and (2) plots…

This study examined the digital and social media communication practices of nine urban universities including UMSL and compared those to known corporate best practices. The purpose of this study was to (1) research how these universities are using social/digital communications to engage with students and prospective students; (2) compare the…

In this research, the cut score of a foundation university was re-calculated with bookmark method and with Angoff method, each of which is a standard setting method; and the cut scores found were compared with the current proficiency score. Thus, the final cut score was found to be 27.87 with the cooperative work of 17 experts through the Angoff…

A short 27 months ago, two groups of U.S. states were each awarded more than $175 million to design, develop, and pilot test a new generation of assessments (U.S. Department of Education, 2010). These new tests will replace assessments in English language arts and mathematics that are currently in use within state and federal accountability…

In 2011, the College Board released its SAT college and career readiness benchmark, which represents the level of academic preparedness associated with a high likelihood of college success and completion. The goal of this study, which was conducted in 2008, was to establish college success criteria to inform the development of the benchmark. The…

Inconsistency in the use of Virtual Learning Environments (VLEs) has led to dissatisfaction amongst students and is an issue across the Higher Education sector. This paper outlines research undertaken in one faculty within one university to ascertain staff and student views on minimum standards within the VLE; how the VLE could reduce student…