This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

This paper presents the findings of a four-year research project studying change practice and agency in higher education. The main findings of five empirical studies are presented. These findings lay bare how academic staff perceive opportunities to change their practice, identify leaders' strategies when trying to bring about change, illustrate…

The aim of this article is to describe the Community and Youth Collaborative Institute School Experience Surveys (CAYCI-SES). The CAYCI-SES measures are free and available to use with permission. The tools include valid and reliable surveys, assessments, and scales to help school stakeholders to identify and assess school climate and other…

Competency-based education systems hold promise for maximizing high-quality teaching and learning for the growth of all students. Such systems, if well designed and implemented, can serve critical equity aims by ensuring that all students are supported in meeting key learning and development targets. Competency-based education systems, however,…

International large-scale assessments (ILSAs) are one of the most important tools policymakers and other educational stakeholders have to inform evidence based decision making for educational reform. Despite this, and the widespread use of ILSA data, results are sometimes misunderstood or misinterpreted. Here, we offer a brief guide to ILSAs and…

This National Academy of Education (NAEd) volume provides guidance to key stakeholders on how to accurately report and interpret comparability assertions concerning large-scale educational assessments as well as how to ensure greater comparability by paying close attention to key aspects of assessment design, content, and procedures. The goal of…

Science, Technology, Engineering, and Mathematics (STEM) education has become increasingly important in the US due to its influence on the nation's educational needs, the creation of a skilled labor force, and opportunities for more tech-savvy workers. However, the evaluation approaches and methodologies used in STEM education programs have come…

This article describes a faculty-led project to assess and revise institutional student learning outcomes at a small urban community college. The revision process involved four stages: (1) exploring stakeholders' explicit and implicit understandings through an experimental assessment; (2) using statistical tools to identify redundancies and…

The Elementary and Secondary Education Act of 1965 (ESEA) requires each State to establish a methodology for identifying schools for support and improvement, based on data from the statewide system of annual meaningful differentiation. This guidance is designed to support State educational agencies (SEAs), local educational agencies (LEAs), and…

Education is a transformative force with the potential to reshape socio-political structures, promote equity, and drive social progress. However, in Pakistan, elite capture presents a significant challenge to the education system, spreading disparities and restricting access to quality education by marginalised communities. Therefore, our…

School climate research has traditionally been carried out by separating its two main components, prosocial and antisocial behaviors. This is often a partial view of the school climate. Hence, the goal of this study is to develop an evaluation instrument (CONVIVE) that takes into account both perspectives of the school climate through a…

The current paper describes the process used for developing the Guidelines for Diagnosis and Assessment of Children, Adolescents, and Adults with Learning Disabilities-Consensus Statement and Supporting Documents, and the rationale for some of the decisions. The guidelines were developed by a cross-sectoral working group of psychologists who…

Rapid Cycle Quality Improvement (RCQI) is often required for behavioral health work force training and evaluation projects supported by the U.S. Health Resources and Services Administration (HRSA). The RCQI process is well established within healthcare but under-utilized in academia to improve teaching and learning. We created and piloted the…

The U.S. Department of Education (Department) Office of Inspector General (OIG) annual plan identifies the audits, inspections, and other activities that the OIG intends to undertake to assist the Department in fulfilling its responsibilities to America's citizens and students. The FY 2023 Annual Plan details the assignment areas and resources…

This position statement presents a summative argument against current structures and practices of assessment in England's primary schools, and some key principles for its replacement. The text was agreed by More Than A Score, a broad coalition of professional, curriculum, research and campaigning organisations opposed to the current assessment…