Raters must score accurately and consistently for classroom observation scores to be valid. This requires (a) a standard defining when scoring is accurate and consistent enough and (b) measuring and remediating rater performance against that standard. Current practice has focused on this second problem to the exclusion of the first. My goal here…

The post-1980s changes in the global higher education landscape have triggered a burgeoning of incidents of academic corruption in higher education institutions. Since 2000, the discourse on how to combat academic corruption has gained traction in higher education and quality assurance is advanced as one of the strategies for fighting corruption…

The design and psychometric methodology of the National Assessment of Educational Progress (NAEP) is constantly evolving to meet the changing interests and demands stemming from a rapidly shifting educational landscape. NAEP has been built on strong research foundations that include conducting extensive evaluations and comparisons before new…

Through professional associations and graduate preparation programs, members of the student affairs profession identify, communicate, and reinforce professional standards to promote the scholarship of practice.

The National Assessment Governing Board (the Board) contracted with Pearson to design and implement a review of the achievement level descriptions (ALDs) for National Assessment of Educational Progress (NAEP) Grade 8 assessments in Science, U.S. History, and Civics. This document describes the procedural and technical aspects and outcomes of the…

This article uses discourse analysis techniques associated with Foucauldian archaeology to examine the two international charters developed by the International Geographical Union Commission on Geographical Education (IGU-CGE), the original one in 1992 and the revised version endorsed in 2016 at the Beijing conference. The examination considers…

A well-constructed just qualified candidate (JQC) description is needed to arrive at a reasonable passing score for licensure tests. Traditionally, such descriptions consist of a list of knowledge and skill statements without sufficient context to internalize its intended meaning, allowing the standard-setting panelists to make idiosyncratic…

This brief examines state-defined long-term goals for improving achievement in states' Every Student Succeeds Act (ESSA) plans as of January 2018, and offers early insights into the varied approaches states have taken in setting long-term goals, timelines, and trajectories to reach their goals.

Validating performance standards is challenging and complex. Because of the difficulties associated with collecting evidence related to external criteria, validity arguments rely heavily on evidence related to internal criteria--especially evidence that expert judgments are internally consistent. Given its importance, it is somewhat surprising…

Large-scale performance assessment programs are a longstanding reform tool. However, standard setting can be a challenge for assessment programs that use primarily non-standardized assessments. The purpose of this paper is to extend this field of research by explaining the standard setting methodology applied to one more recent instantiation of a…

This research aims to create and validate the quality of performance assessment using functional analysis. The researchers employed a design-based research method to create core competencies and their workload-based key outcome indicators as a preliminary study encompassing two phases, before formulating a standards-setting appraisal model to…

Introductory physics lab instruction is undergoing a transformation, with increasing emphasis on developing experimentation and critical thinking skills. These changes present a need for standardized assessment instruments to determine the degree to which students develop these skills through instructional labs. In the first part of this thesis,…

With a starting point in the tradition of "geisteswissenschaftliche Pädagogik," this article presents a challenge to inclusive education research to engage a Continental perspective on educational research. The motivation is to entice inclusive education researchers to begin to ask educational questions of inclusion, as opposed to…

Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g.…

Within the early childhood education system, early childhood teachers are the weak element in two hierarchies, the governance hierarchy and the epistemological hierarchy. From the perspective of early childhood teacher professionalization, this is a paradox because professionalism is intrinsically linked to a relatively high degree of professional…