This paper introduces the new Massachusetts Performance Assessment for Leaders (PAL) and uses critical policy analysis to re-examine the validity evidence (using the 2014 Standards for Educational and Psychological Testing and a theory of multicultural validity) for the use and interpretation of the PAL in regards to emerging school leadership.…

The ubiquitous use of standardized test results to make varied judgments about educators, students, and schools within the public school system raises concerns of validity. If the test results have not been validated for making multiple determinations, then the decisions made about educators, students, schools, and school districts based on the…

Just like all the high-stakes tests that determine students' futures nowadays, The Chorizo Test is a standardized test rooted in the culture of the test makers. It was originally created to be used with students in teacher training programs to sensitize them to the pitfalls inherent in standardized pencil-and-paper tests, such as linguistic bias…

In this article we provide a critique of the interpretation and utilization of Programme for International Student Assessment (PISA) results by the National Education Authorities in Turkey. First, we define and explain what OECD's PISA is. Second, we make an overview of the media coverage in Turkey of the PISA 2003 and 2006 results. Third, we…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

Paul Newton (2010), with his characteristic concern about theory, has set out two different ways of thinking about the basis upon which equivalences of one sort or another are established between test score scales. His reason for doing this is a desire to establish "the defensibility of linkages lower on the continuum than concordance."…

This article presents the author's rejoinder to thinking about linking from issue 8(1). Particularly within the more embracing linking frameworks, e.g., Holland & Dorans (2006) and Holland (2007), there appears to be a major disjunction between (1) classification discourse: the supposed basis for classification, that is, the underlying theory…

"Linking" is a term given to a general class of procedures by which one represents scores X on one test or measure in terms of scores Y on another test or measure. A recent taxonomy by Holland and Dorans (2006; Holland, 2007) organizes the various types of links into three broad categories: prediction, scale aligning, and equating. In…

Newton's article (2010) makes three main contributions to the literature. First, it is transatlantic, bringing together literatures that have been dealing with similar problems, using sometimes different methods and certainly with distinctive educational, cultural perspectives. He points out that neither of these literatures has all of the…

The article "Thinking About Linking" by Newton (2010) presents a novel philosophical perspective on the way that educational assessments should be linked. Newton starts by describing the linking framework as it was characterized in various publications and identifies a cross-cultural dimension in the definitions and uses of test…

High-stakes assessments are those in which the results of tests or other measures can lead to decisions that may affect school administrators, teachers, and students substantially. Whether high-stakes assessment results in misleading information due to extraneous factors associated with the conditions under which the assessment occurs is explored.…

The topic of high-stakes testing (HST) is important because HST has direct and indirect effects on career-technical education (CTE) programs and timely because HST increasingly enters public discussion and has produced a large body of research and practice that generalizes to CTE. A review of HST has identified two persisting dilemmas: policy and…

The assumption that reliability is a necessary but insufficient condition for validity in assessment is challenged by exploring a dialectic between psychometric and hermeneutic approaches to drawing and warranting interpretations of human products of performance. Hermeneutic alternatives for epistemological and ethical purposes expand the range of…

Standardized test scores are used to determine outcomes at national, state, and local school district levels; and teachers feel pressure to raise their students' scores on high stakes tests. This study evaluated score enhancing strategies most likely used by student teachers and their perceptions about the degree of appropriateness of these…

A study using the static-group research design was performed comparing the raw standardized Stanford 9 high stakes test scores of career and technical education (CTE) students with those of other students while controlling for extraneous variables such as learning styles, special populations, gender, race, and ethnicity. Two thousand high school…