The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test…

The institutions in education use various assessment methods to decide on the proficiency levels of students in a particular construct. This study investigated whether the decisions differed based on the type of assessment: norm-and criterion-referenced assessment. An achievement test with 20 multiple-choice items was administered to 107 students…

All students confronted obstacles during the 2020 school year, but for students learning English, the year presented a distinct set of difficulties. Even as English Learner (EL) students shared in the common struggles around internet-based instruction, the tools to measure their progress in becoming proficient in English became largely unavailable…

This study addressed the impact that undergraduate teacher education programs have on preservice educators, and upon the quality of education that urban-minority school communities receive. The problem is that variances exist among the standards used for undergraduate teacher education programs with specific regard to culturally responsive…

The dialogue on what constitutes quality teacher preparation and how it should be assessed and evaluated is muddled. It begins neatly with a universal agreement and aspiration for quality teaching and enhanced PK-12 student achievement, then quickly scatters when there are attempts to define and weigh key components of academic excellence.…

The ambitious goals of standards-based reform call for both technical and adaptive leadership to address problems of practice involving the technical and adaptive alignment of teachers' instruction to the standards. Thus, standards-aligned curriculum implementation necessitates both types of strategies; otherwise, adaptive challenges will persist.…

This article conceptualises the relationship between exam board insider research and the policy-making context in which they operate. Exam board researchers are constrained by commercial and political interests in disclosing their knowledge. and face pressures in disseminating research, but also find themselves working in contexts where calls to…

Given the significant global influence of the Common European Framework of Reference for Languages: Teaching, Learning, and Assessment (CEFR) on English language education, this study deals with aligning a university's academic reading tests to the CEFR. It aimed at validating the test construct of the academic reading tests in relation to the…

The objective structured practical examination (OSPE) is a reliable assessment of practical skills in anatomy teaching. It is often administered as low-stake assessments to track progress at multiple time points in anatomy curricula. Standard-setting OSPEs to derive a pass mark and to ensure assessment quality and rigor is a complex task. This…

The redesigned "TOEIC Bridge"® tests are designed to measure the reading, listening, speaking, and writing proficiency of beginning to low-intermediate English learners in the context of everyday adult life. This report describes the comprehensive and multifaceted process used to enhance the meaningfulness of TOEIC Bridge test score…

An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability associated with judges (and possibly panels) contributes error to the resulting cut score. The variability associated with items plays a more complicated role. To the extent that the mean item…

In this study, the efficiency of various random sampling methods to reduce the number of items rated by judges in an Angoff standard-setting study was examined and the methods were compared with each other. Firstly, the full-length test was formed by combining Placement Test 2012 and 2013 mathematics subsets. After then, simple random sampling…

A key part of determining cut-scores when performing Angoff standard setting is utilizing equating methods to place standard-setting ratings onto the scale used to report scores to examinees. This article describes three equating methods that can be employed to place Angoff ratings onto the scale used to report scores to examinees when applying…

Background: Stakeholders' interpretations of the findings of large-scale educational assessments can influence important decisions. In the context of educational assessment, standard-setting remains an especially critical element, because it is complex and largely unstandardized. Instruments established by means of standard-setting procedures such…

Sign languages present particular challenges to language assessors in relation to variation in signs, weakly defined citation forms, and a general lack of standard-setting work even in long-established measures of productive sign proficiency. The present article addresses and explores these issues via a mixed-methods study of a human-rated…