On February 18, 2015, the New York State Education Department (NYSED) conducted a Performance Level Description Development meeting in Albany, New York. The meeting was convened to articulate the knowledge and skills expected of students at each level of performance, consistent with the policy vision set forth by the NYSED. The Performance Level…

As more and more cities and states diversify the educational options available to parents and students, creating magnet, open-enrollment, small school, career and technical, charter, and private school opportunities, educational choice markets need to become a part of the regulation conversation. In this report, Mike McShane examines the…

Current educational reform, policy and public discourse emphasise standardisation of testing, curricula and professional practice, yet the landscape of literacy practices today is fluid, interactive, multimodal, ever-changing, adaptive and collaborative. How then can English and literacy educators negotiate these conflicting terrains? The nature…

Education bureaucrats in 45 states have approved the Common Core State Standards ([CCSS], 2010) as the de facto national curriculum. The implementation of the CCSS will be monitored by a national standardized test in language arts and mathematics. The confluence of a standardized curriculum enforced with a standardized test will entrench a…

Language testers operate within two frames of reference: norm-referenced (NRT) and criterion-referenced testing (CRT). The former underpins the world of large-scale standardized testing that prioritizes variability and comparison. The latter supports substantive score meaning in formative and domain specific assessment. Some claim that the…

Well before the examinations grade crisis of 2012, Michael Gove had set out clear intentions for reforming public examinations. Though he claimed to be improving examinations and assessment by replicating practices that took place in high-performing countries and thus improving the ability of the UK economy to "compete", this…

In South Africa, the Department of Basic Education and Training (DBE) is responsible for primary and secondary education (Grades R-12). In an effort to improve educational standards in literacy, numeracy and mathematics, especially in the Foundation Phase (FP) levels of education, the DBE has developed several initiatives and campaigns. To monitor…

The purpose of this study is to describe a new approach for evaluating the judgments of standard-setting panelists within the context of the bookmark procedure. The bookmark procedure is widely used for setting performance standards on high-stakes assessments. A many-faceted Rasch (MFR) model is proposed for evaluating the bookmark judgments of…

Standard-setting research has relied very heavily on certain types of information that, although helpful, may be inadequate for judging the quality of standard-setting results. To increase confidence in standard-setting results, the measurement community must understand far more about the panelists' task and about the factors that influence their…

Over the past 35 years, the public, as well as state and federal policy makers, have increasingly pressured higher education to create a culture of evidence and, specifically, to account for student learning. While virtually all states report on collegiate learning using proxies (e.g., graduation rates), colleges and universities are now being…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

The Bookmark method for setting standards on educational tests is currently one of the most popular standard-setting methods. However, research to support the method is scarce. In this report, we review the published and unpublished literature on this method as well as some seminal work in the area of evaluating standard-setting studies. Our…

The U.S. Department of Education's latest move to grant more flexibility under the No Child Left Behind Act, this time aimed at helping schools that narrowly miss the law's requirement for high participation on standardized tests, was generally welcomed. The appetite for further adjustments appears to be growing. The new policy allows states to…

The officially reported impressive rises in standards in mathematics and English in primary schools since 1995 are challenged. The article looks at the increases from four different perspectives. First, the general pattern of change is considered. Secondly, the statutory test data are compared with the results from several different studies. These…

Panelists in an operational standard-setting study were asked to share their thoughts in written form at important points in the process itself--before the meeting started, after training, after completing the 1st and 2nd sets of ratings, immediately following the discussion between Rounds 1 and 2, and so on. The item mapping method of Plake and…