The U.S. Department of Education has required educational collection and reporting. For postsecondary institutions, this requirement has evolved from the Higher Education General Information Survey (HEGIS), which was used from the 1960s to the 1980s, to the Integrated postsecondary Education Data System (IPEDS) (Aliyeva, Cody, & Low, 2018).…

This research brief describes recent methodological initiatives with the Public Libraries Survey. It describes how starting with the 2022 data, Institute of Museum and Library Services (IMLS) updated geographic identifiers to better align Census Bureau geography types with the library's legal service area, with the goal of enabling data users to…

While the field advocates for a diversified and comprehensive professional role (National Association of School Psychologists, 2020), school psychologists have long spent most of their time in assessment-related activities (Farmer et al., 2021), averaging about eight cognitive evaluations monthly (Benson et al., 2020). Assessment practices have…

In Part 1 of this series, the authors briefly reviewed some challenges inherent in using standardized tools with students who are not well represented in norming data. To help readers clearly conceptualize the framework steps, the authors present two case studies that showcase how a nonstandardized approach to assessment can be individualized to…

Education can be transformed if we eradicate our fixation on big data like standardized test scores as the supreme measure of equity and learning. Instead of the focus being on "fixing" and "filling" academic gaps, we must envision and rebuild the system from the "student" up--with classrooms, schools and systems…

This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

Systematic reviews (SRs) have an important role in the healthcare decision-making practice. Assessing the overall confidence in the results of SRs using quality assessment tools, such as "A MeaSurement Tool to Assess Systematic Reviews 2" (AMSTAR 2), is crucial since not all SRs are conducted using the most rigorous methods. In this…

Racial bias in research impacts a study's relevancy, validity and reliability, though presently this aspect is not addressed in critical appraisal tools, and consequently appraisers may not take racial bias into account when assessing a paper's quality. Drawing on critical race theory (CRT) tenets that racism is ubiquitous and race a social…

Effect sizes are important because they are an accessible way to indicate the practical importance of observed associations or differences. Standardized mean difference (SMD) effect sizes, such as Cohen's d, are widely used in education and the social sciences -- in part because they are relatively easy to calculate. However, SMD effect sizes…

Enzymes are nature's catalysts, mediating chemical processes in living systems. The study of enzyme function and mechanism includes defining the maximum catalytic rate and affinity for substrate/s (among other factors), referred to as enzyme kinetics. Enzyme kinetics is a staple of biochemistry curricula and other disciplines, from molecular and…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

One tool that many families own, across the globe, is a basic mobile phone. The use of low-cost basic mobile phones for educational purposes in humanitarian settings is critical where access to connectivity and higher cost devices is limited. The portability of mobile phones, combined with their communication features, offers multiple uses to…

Educational games help reinforce educational concepts. They help students learn through hypothesizing, probing, and reflecting upon the game environment. Understanding the impact of a game is important before deploying it in a class. Recent studies in learning analysis describe methodologies and approaches for analyzing educational games. However,…

Parents and the public use accountability data to judge if schools are doing a good or a bad job educating their students. However, using the current data, schools perceived as "good" tend to be in better-resourced districts and enroll higher percentages of wealthy and white students. Schools perceived as "bad" tend to be in…