The U.S. Department of Education has required educational collection and reporting. For postsecondary institutions, this requirement has evolved from the Higher Education General Information Survey (HEGIS), which was used from the 1960s to the 1980s, to the Integrated postsecondary Education Data System (IPEDS) (Aliyeva, Cody, & Low, 2018).…

This research brief describes recent methodological initiatives with the Public Libraries Survey. It describes how starting with the 2022 data, Institute of Museum and Library Services (IMLS) updated geographic identifiers to better align Census Bureau geography types with the library's legal service area, with the goal of enabling data users to…

While the field advocates for a diversified and comprehensive professional role (National Association of School Psychologists, 2020), school psychologists have long spent most of their time in assessment-related activities (Farmer et al., 2021), averaging about eight cognitive evaluations monthly (Benson et al., 2020). Assessment practices have…

In Part 1 of this series, the authors briefly reviewed some challenges inherent in using standardized tools with students who are not well represented in norming data. To help readers clearly conceptualize the framework steps, the authors present two case studies that showcase how a nonstandardized approach to assessment can be individualized to…

Metrics, outcomes, and assessment are important, yet often forgotten, elements of effective leadership programs. This article will provide an overview of metrics, outcomes, and assessment in regard to leadership programs. The article will then provide example programs and practical guidance on using metrics, outcomes, and assessment in leadership…

Program evaluation can seem like a daunting task, but it is an important charge to undertake. This article is designed to provide gifted coordinators, teachers, and anyone else who wants to complete a program evaluation with guidance on how to work through a program evaluation by establishing the importance of program evaluation (e.g., Callahan,…

Education can be transformed if we eradicate our fixation on big data like standardized test scores as the supreme measure of equity and learning. Instead of the focus being on "fixing" and "filling" academic gaps, we must envision and rebuild the system from the "student" up--with classrooms, schools and systems…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

Systematic reviews (SRs) have an important role in the healthcare decision-making practice. Assessing the overall confidence in the results of SRs using quality assessment tools, such as "A MeaSurement Tool to Assess Systematic Reviews 2" (AMSTAR 2), is crucial since not all SRs are conducted using the most rigorous methods. In this…

Racial bias in research impacts a study's relevancy, validity and reliability, though presently this aspect is not addressed in critical appraisal tools, and consequently appraisers may not take racial bias into account when assessing a paper's quality. Drawing on critical race theory (CRT) tenets that racism is ubiquitous and race a social…

Effect sizes are important because they are an accessible way to indicate the practical importance of observed associations or differences. Standardized mean difference (SMD) effect sizes, such as Cohen's d, are widely used in education and the social sciences -- in part because they are relatively easy to calculate. However, SMD effect sizes…

Enzymes are nature's catalysts, mediating chemical processes in living systems. The study of enzyme function and mechanism includes defining the maximum catalytic rate and affinity for substrate/s (among other factors), referred to as enzyme kinetics. Enzyme kinetics is a staple of biochemistry curricula and other disciplines, from molecular and…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

Educational games help reinforce educational concepts. They help students learn through hypothesizing, probing, and reflecting upon the game environment. Understanding the impact of a game is important before deploying it in a class. Recent studies in learning analysis describe methodologies and approaches for analyzing educational games. However,…