Since the No Child Left Behind Act (No Child Left Behind [NCLB], 2001) was enacted, the Bookmark method has been used in many state standard setting studies (Karantonis and Sireci; Zieky, Perie, and Livingston). The purpose of the current study is to evaluate the criticism that when panelists are presented with data during the Bookmark standard…

Evaluations are practiced in political contexts, posing ethical dilemmas to evaluators. It is important, therefore, to prepare evaluation students for ethical decision-making in their future evaluative work. This study explores the use of scenario-based moral reasoning and ethical argumentation as an instructional strategy for teaching evaluation…

Although there are studies on the pragmatic assessment, to date no research has been done on native English raters' criteria for the assessment of EFL learners' pragmatic competence. Focusing on this topic, this study pursued two purposes. The first one was to find the criteria for rating the speech act of apology in L2 by native English teachers.…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

The onset of injury and disability can have a significant negative effect on individuals' social, interpersonal and vocational participation. This in turn impacts on individuals' current and future earning capacity. An objective assessment of post-injury work capacity is often sought through legal processes to determine the extent of this…

This study identifies a unique context for exploring lay understandings of language testing and, by extension, for characterizing the nature of language assessment literacy among non-practitioners, stemming from data in an inquiry into the registration processes and support for overseas trained doctors by the Australian House of Representatives…

This chapter describes the author's experience and insights as the chief of evaluation for public diplomacy at the U.S. Department of State, and as a consultant assisting federal agencies in a multitude of evaluation activities relating what helps and hinders internal evaluation functions. The article discusses the challenges faced by the internal…

The lack of sound and practical guidelines and materials, which precludes adequate technical assistance, is one cause of the inferior quality of evaluation practices in bilingual education. Other contributing factors include incompetent program evaluators, misinformed local administrations, inappropriate state and federal policies, and complex…