In this paper we assert that the practice of principled assessment design renders traditional standard-setting methodology redundant at best and contradictory at worst. We describe the rationale for, and methodological details of, Embedded Standard Setting (ESS; previously, Engineered Cut Scores. Lewis, 2016), an approach to establish performance…

A major challenge in the widespread application of Mokken scale analysis (MSA) to educational performance assessments is the requirement of complete data, where every rater rates every student. In this study, simulated and real data are used to demonstrate a method by which researchers and practitioners can apply MSA to incomplete rating designs.…

This study introduces a novel differential item functioning (DIF) method based on propensity score matching that tackles two challenges in analyzing performance assessment data, that is, continuous task scores and lack of a reliable internal variable as a proxy for ability or aptitude. The proposed DIF method consists of two main stages. First,…

This self-paced online course provides educators with detailed information on creating and using performance assessments. Through five 30-minute modules, practitioners, instructional leaders, and administrators will learn the foundational concepts of assessment literacy and how to develop, score, and use performance assessments. They will also…

edTPA is an educative performance assessment designed to measure teacher readiness. It has gained momentum across the country; yet, it has met with resistance from educators in various roles. Previous studies have reported concerns that the assessment is a barrier to the profession and that it undermines the educational value inherent in the…

The purpose of this study is to explore how neoliberal ideas have been institutionally contextualized in Korean and Japanese higher education. As Japan and Korea are both located in Northeast Asia, they have long influenced each other's society and economics, and higher education is no exception. Since 1990, the governments and universities in…

The micro-level enactment of elite sport policy has received little critical coverage in the sociology of sport subdiscipline. This paper provides original insights into how coaches working in professional youth football academies variously interpreted, experienced and engaged with The FA Premier League's Elite Player Performance Plan (EPPP).…

Extending previous research on the Computers Are Social Actors paradigm and the human-to-human interaction script, this study examines the interpersonal impressions of a social robot evaluator versus a human evaluator in a performance evaluation context. A between-subjects experiment was conducted to measure participants' impressions of the…

Teaching evaluation is an important issue in the learning process in higher education. In addition to the teaching evaluation on campus, feedback from alumni is also very important to instruction improvement. Undergraduates and graduates in universities are the main labor force in Taiwan; therefore, many higher education institutions pay attention…

While the COVID-19 pandemic disrupted conventional assessment practices, it offers an opportunity to reconsider the purposes and types of assessment used to evaluate student learning and inform instruction. Cancellation of spring 2020 student assessments and the freezing of school accountability status gave many districts and schools an…

Undergraduate medical education aims to train the students to develop the required clinical skills and preparation for the residency. The validity of the assessment on clinical competence is primarily ignored or uncompleted, especially in the clinical clerkship. The current study was multifaceted and accomplished multiple evaluation and research…

In the United States, financial incentives have been used by the U.S. Government to reward performance at colleges and universities since the 1960s. Various case-studies have documented that incentivization programs may not result in positive outcomes. The purpose of this qualitative, multiple case study was to identify two-year, public colleges'…

This program memorandum informs states that the U.S. Departments of Labor and Education (the Departments) have determined it is appropriate and reasonable for the Department of Labor (DOL) to begin assessing performance for two performance indicators under Workforce Innovation and Opportunity Act (WIOA) title I and III core programs for Program…

This study examined the evaluations of special education teachers in a Midwest Public Special Education District which consisted of five separate special education schools. Despite the vast research and literature on evaluations of general education teachers throughout the nation, there was little research on the evaluations of special education…

This study uses narrative analysis to track undergraduates' proof schemes throughout a transition proofs course at a research 1 university in the Midwest, with a focus on student example use and how it influences their schemes. Assessment data and cognitive interviews were conducted at four points throughout the semester in order to track the…