International large-scale assessments (ILSAs) are one of the most important tools policymakers and other educational stakeholders have to inform evidence based decision making for educational reform. Despite this, and the widespread use of ILSA data, results are sometimes misunderstood or misinterpreted. Here, we offer a brief guide to ILSAs and…

This National Academy of Education (NAEd) volume provides guidance to key stakeholders on how to accurately report and interpret comparability assertions concerning large-scale educational assessments as well as how to ensure greater comparability by paying close attention to key aspects of assessment design, content, and procedures. The goal of…

Purpose: This paper considers the implications of reform efforts that rely on charter management organizations to assume operational control of underperforming neighborhood schools. The purpose of this paper is to examine the way in which changes to the education sector place enormous pressure on these organizations to both manage instruction and…

Although much attention has been given to rater effects in rater-mediated assessment contexts, little research has examined the overall stability of leniency and severity effects over time. This study examined longitudinal scoring data collected during three consecutive administrations of a large-scale, multi-state summative assessment program.…

In response to the call for more rigorously validated educational assessments, this study used an iterative multimethod validation process to develop and validate outcomes from the 21st Century Skills Assessment global rating scale. Qualitative and quantitative data sources were used to inform four types of validity evidence: content, response…

This article questions whether social justice can live within the structural racism present in the field of evaluation. Structural racism refers to the totality of ways in which societies foster racial discrimination through mutually reinforcing systems of housing, education, employment, earnings, benefits, credit, media, health care, and criminal…

This paper examines how a standards-based form of assessment in operation in New Zealand has impacted upon the knowledge taught to secondary history students. The segmentation of history into assessable components along with assessment mechanisms which encourage the reduction in the number of standards being attempted has impacted upon both the…

There has been a call for balanced assessment systems which resulted from a recognition that most state summative assessments poorly served the primary purpose of assessment: improving learning and instruction. Educators understand that large-scale summative tests are far too distal from instruction, at the wrong grain size, and administered at…

The purpose of this study is to provide insight into strategies that promote a practice of evaluation in community colleges. This study focuses on the aspects of organizational culture including employee engagement, leadership participation, evaluation practices, values and expectations, organizational norms, and benefit and incentive system…

The Elementary and Secondary Education Act of 1965 (ESEA) requires each State to establish a methodology for identifying schools for support and improvement, based on data from the statewide system of annual meaningful differentiation. This guidance is designed to support State educational agencies (SEAs), local educational agencies (LEAs), and…

Education is a transformative force with the potential to reshape socio-political structures, promote equity, and drive social progress. However, in Pakistan, elite capture presents a significant challenge to the education system, spreading disparities and restricting access to quality education by marginalised communities. Therefore, our…

School climate research has traditionally been carried out by separating its two main components, prosocial and antisocial behaviors. This is often a partial view of the school climate. Hence, the goal of this study is to develop an evaluation instrument (CONVIVE) that takes into account both perspectives of the school climate through a…

The current paper describes the process used for developing the Guidelines for Diagnosis and Assessment of Children, Adolescents, and Adults with Learning Disabilities-Consensus Statement and Supporting Documents, and the rationale for some of the decisions. The guidelines were developed by a cross-sectoral working group of psychologists who…

Rapid Cycle Quality Improvement (RCQI) is often required for behavioral health work force training and evaluation projects supported by the U.S. Health Resources and Services Administration (HRSA). The RCQI process is well established within healthcare but under-utilized in academia to improve teaching and learning. We created and piloted the…

The U.S. Department of Education (Department) Office of Inspector General (OIG) annual plan identifies the audits, inspections, and other activities that the OIG intends to undertake to assist the Department in fulfilling its responsibilities to America's citizens and students. The FY 2023 Annual Plan details the assignment areas and resources…