This Perspective article expands on a working memory-dependent dual-process model, originally proposed by Zheng et al., to elucidate individual differences in the testing effect. This model posits that the testing effect comprises two processes: retrieval-attempt and post-retrieval re-encoding. We substantiate this model with empirical evidence…

Formal graduate education in a measurement related field provides a solid foundation for professionals who work on credentialing examinations. Those foundational skills are then expanded and refined over time as practitioners encounter complex and nuanced challenges that were not covered by or go beyond the context described in textbooks. For…

This module is designed for educators, educational researchers, and psychometricians who would like to develop an understanding of the basic concepts of validity theory, test validation, and documenting a "validity argument." It also describes how an in-depth understanding of the purposes and uses of educational tests sets the foundation…

Common sense is a dynamic concept and it is natural that our (statistical) common sense lags behind the development of statistical science. What is not so easy to understand is why common sense lags behind as much as it does. We conduct a survey among Japanese students and provide examples and tentative explanations of a number of statistical…

Administrative problems such as computer malfunction and power outage occasionally lead to missing item scores and hence to incomplete data on mastery tests such as the AP and U.S. Medical Licensing examinations. Investigators are often interested in estimating the probabilities of passing of the examinees with incomplete data on mastery tests.…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Using an in-class field experiment, the authors study how cooperative learning affects trust, attitudes about group work, and performance. Students in some classrooms completed in-class quizzes individually, and students in other classrooms completed them in pairs. Completing quizzes in pairs led to higher levels of within-class trust, indicating…

The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency…

For many professors, testing is primarily a tool for assessing the learning of students. However, research into the "testing effect" has established the value of testing also as a learning tool, not just as an assessment tool. This article provides an overview of this research and also of my own experiences in using a variety of testing…

The National Assessment of Educational Progress (NAEP) is an integral measure of academic progress across the nation and over time. It is the largest nationally representative and continuing assessment of what our nation's students know and can do in various subjects, such as civics, mathematics, reading, and U.S. history. The program also…

Ten years ago, the author worked as the Director of Assessments for the District of Columbia Public Schools (DCPS). For temporal context, the author arrived after the first of the infamous test cheating scandals and left just before the incident that spawned a second. Indeed, the author filled a new position created to both manage test security…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. The Florida assessment policies and guidelines presented in this technical assessment paper are appropriate for state and federal reporting. Therefore, guidance and procedures regarding the selection…

This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. Rule 6A-6.014, Florida Administrative Code (F.A.C.), General Requirements for Adult General Education Programs, provides a list of assessments that are approved by the U.S. Department of Education (ED)…

As applied linguists and language testers, we are in the business of "doing language". For many of us, language learning is a lifelong passion, and we invest similar enthusiasm in our language assessment research and testing practices. Language is also the vehicle through which we communicate that enthusiasm to others, sharing our…

This article reviews the administrative, scoring, and psychometric properties of the Wechsler Individual Achievement Test, Fourth Edition (WIAT-4, NCS Pearson, 2020). The WIAT-4 is one of the more commonly administered broadband measures of academic achievement. The instrument was determined to be well-conceptualized, and generally…