This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

Standard-setting is an essential component of test development, supporting the meaningfulness and appropriate interpretation of test scores. However, in the high-stakes testing environment of aviation, standard-setting studies are underexplored. To address this gap, we document two stages in the standard-setting procedures for the Overseas Flight…

The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test…

Given the significant global influence of the Common European Framework of Reference for Languages: Teaching, Learning, and Assessment (CEFR) on English language education, this study deals with aligning a university's academic reading tests to the CEFR. It aimed at validating the test construct of the academic reading tests in relation to the…

In this study, we present the development of individualized feedback for a large-scale listening assessment by combining standard setting and cognitive diagnostic assessment (CDA) approaches. We used the performance data from 3,358 students' item-level responses to a field test of a national EFL test primarily intended for tertiary-level EFL…

Placing non-native speakers of English into appropriate classes involves mapping placement test scores onto proficiency levels based on predetermined cut scores. However, studies on how to set boundaries for different levels of proficiency have been lacking in the language testing literature. A top-down approach to standard setting in which a…

This study aimed at developing the Silpakorn Test of English Proficiency (STEP), in alignment with the Common European Framework of Reference for Languages (CEFR), and in accordance with the theoretical framework established by Alderson et al. (2006). Four major steps were involved in the test construction. First, English language lecturers who…

In the field of second and foreign language learning, the Common European Framework of Reference for languages (CEFR) is widely-used for setting language proficiency standards within European, and increasingly global, contexts. Few studies, however, have investigated the ways in which systemic, macro-level factors within national educational…

The Common European Framework of Reference for Languages (CEFR) is widely used in setting language proficiency requirements, including for international students seeking access to university courses taught in English. When different language examinations have been related to the CEFR, the process is claimed to help score users, such as university…

The Every Student Succeeds Act (ESSA) requires states to outline their academic and English language proficiency goals and provide a detailed proposal for the statewide accountability system in a state ESSA plan. This brief, a collaboration between Achieve and UnidosUS, provides a two-part analysis of states' goals for English learners (ELs) in…

In the traditional higher education sphere, AAC&U's "Essential Learning Outcomes" (ELO 2012) and the Lumina Foundation sponsored "Degree Qualifications Profile" (DQP 2014) both set forth, in different ways, concrete expectations for student learning that include what symbolic translation and its infusions is about. Both…

The aim of the study is to compare TIMSS 2011 proficiency levels with the proficiency levels defined by the researchers using cluster analysis for Turkey, Korean, Norway, and Morocco in 4th and 8 th grades in the fields of science and mathematics. Therefore, it is tried to be reached that these cut-off scores for each country can serve the…

The authors illustrate models and procedures that can be applied to calculate overall composite scores in order to identify an indicator of English language proficiency, based on composite scores for English learners with 504 or individualized education plans who are missing one or more domain scores on the Assessing Comprehension and…

The discussion takes up the common theme across the seven contributions of this special issue, namely the CEFR's suitability as a basis for setting university entrance standards. The special issue allows insights into this theme from a multitude of contexts, languages and perspectives, including data from stakeholders, students, tests and their…