This article discusses regression effects that are commonly observed in Angoff ratings where panelists tend to think that hard items are easier than they are and easy items are more difficult than they are in comparison to estimated item difficulties. Analyses of data from two credentialing exams illustrate these regression effects and the…

This technical report documents the processes and procedures implemented to support the Spring 2021 Nebraska Student-Centered Assessment System (NSCAS) Phase I Pilot in English Language Arts (ELA), Mathematics, and Science assessments by NWEA® under the supervision of the Nebraska Department of Education (NDE). The technical report shows how the…

With the significant infusion of dollars now available to both states and school districts, we have a unique opportunity to finally reduce high rates of illiteracy, particularly in populations which have been traditionally underserved by an inequitable system of education. Instead of a third of all children entering 4th grade still unable to read…

The study evaluated a recently postponed national test policy on the use of external agencies' English tests measuring four skills for Japanese university admission purposes. Using Kunnan's principles of fairness and justice, we generated and evaluated three claims regarding the test policy: vocabulary coverage of the tests, the justifiability of…

All students deserve to attend programs and institutions that meet high quality standards. But different program goals, investments of time, and eligibility criteria make it difficult to set specific standards that will apply equally well to all types of programs and institutions. This report sets out principles for developing an accountability…

The National Assessment Governing Board has a legislatively mandated responsibility to develop National Assessment of Educational Progress (NAEP) achievement levels. The Board Policy Statement on Developing Student Achievement Levels for the National Assessment of Educational Progress provides policy definitions of "NAEP Basic,"…

In the field of second and foreign language learning, the Common European Framework of Reference for languages (CEFR) is widely-used for setting language proficiency standards within European, and increasingly global, contexts. Few studies, however, have investigated the ways in which systemic, macro-level factors within national educational…

The Common European Framework of Reference for Languages (CEFR) is widely used in setting language proficiency requirements, including for international students seeking access to university courses taught in English. When different language examinations have been related to the CEFR, the process is claimed to help score users, such as university…

In this article, we examine how the ideal university graduate is constructed in the European Commission's documents on entrepreneurship education (EE). Our analysis illustrates how persuasive policy language determines the standards for educating entrepreneurial graduates to optimally meet the needs of the liberal market economy. We argue that the…

The Every Student Succeeds Act (ESSA) requires states to outline their academic and English language proficiency goals and provide a detailed proposal for the statewide accountability system in a state ESSA plan. This brief, a collaboration between Achieve and UnidosUS, provides a two-part analysis of states' goals for English learners (ELs) in…

In the traditional higher education sphere, AAC&U's "Essential Learning Outcomes" (ELO 2012) and the Lumina Foundation sponsored "Degree Qualifications Profile" (DQP 2014) both set forth, in different ways, concrete expectations for student learning that include what symbolic translation and its infusions is about. Both…

This article covers the origins, growth, rationale, calibration, and inspiration of an international pool of certified Quality Matters™ (QM) Peer Reviewers. From the beginning in 2003, as a U.S. Department of Education, Fund for the Improvement of Postsecondary Education funded project, QM was developed as a faculty-centered, peer-based approach…

The thesaurus dataset of educational technology is a knowledge description of educational technology in Chinese. The aims of this thesaurus were to collect the subject terms in the domain of educational technology, facilitate the standardization of terminology and promote the communication between Chinese researchers and scholars from various…

A new probability-based standard setting technique, the Objective Borderline Method (OBM), was introduced recently. This was based on a mathematical model of how test scores relate to student ability. The present study refined the model and tested it using 2500 simulated data-sets. The OBM was feasible to use. On average, the OBM performed well…

In recent years the use of expert judgement to set and maintain examination standards has been increasingly criticised in favour of approaches based on statistical modelling. This paper reviews existing research on this controversy and attempts to unify the evidence within a framework where expertise is utilised in the form of comparative…