Given its centrality to assessment, until the concept of validity includes concern for racial justice, such matters will be seen as residing outside the "real" work of validation, rendering them powerless to count against the apparent scientific merit of the test. As the definition of validity has evolved, however, it holds great…

A diversity of approaches for critically appraising qualitative and quantitative evidence exist and emphasize different aspects. These approaches lack clear processes to facilitate rating the overall quality of the evidence for aggregated findings that combine qualitative and quantitative evidence. We draw on a meta-aggregation of implementation…

In today's world, Principal Preparation Programs (PPPs) need to be innovative in helping principal candidates be more prepared to lead in changing times, but first, they must receive certification successfully. Completing the Praxis exam is the final requirement to gain certification as an instructional leader in Alabama and is often a stressful…

The purpose of this study is to introduce a functional approach for modeling unfolding response data. Functional data analysis (FDA) has been used for examining cumulative item response data, but a functional approach has not been systematically used with unfolding response processes. A brief overview of FDA is presented and illustrated within the…

This article presents the findings of a case study that introduced online quizzes as a form of assessment in pure mathematics. Rather than being designed as an assessment of learning, these quizzes were designed to be an assessment for learning; they aimed to academically support students in their transition from A-Level mathematics to…

The automation of creativity measurement is a promising avenue of development, given that classic creativity assessments face challenges such as resource-intensive expert judgments, subjective creativity ratings, and biases in people's self-reports. In this paper, we present a construct validation study for CollaboUse, a test developed to deliver…

Running Records are thought to be an excellent formative assessment tool because they generate results that educators can use to make their teaching more responsive. Despite the technical nature of scoring Running Records and the kinds of important decisions that are attached to their analysis, few studies have investigated assessor accuracy. We…

This dissertation presents a comprehensive review of the evolution of DIF analysis within educational measurement from the 1980s to the present. The review elucidates the concept of DIF, particularly emphasizing the crucial role of grouping for exhibiting DIF. Then, the dissertation introduces an innovative modification to the newly developed…

The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Acadience Reading (AR) is a screener for early detection of reading problems in elementary students. Limited research exists, however, on its technical adequacy for evaluation of English Learners (ELs). In this study, we tested the long-term predictive validity and diagnostic accuracies of AR and examined the differences between native…

This study's purpose was to investigate effects of 3 intervention approaches for building working memory (WM) and improving word-problem solving (WPS). Children with mathematics difficulties (n = 240; 7.51 years [SD = 0.33]) were randomized to 4 conditions: a control group, general WM training with contiguous math practice, WPS intervention…

The current study investigated how item formats and their inherent affordances influence test-takers' cognition under uncertainty. Adult participants solved content-equivalent math items in multiple-selection multiple-choice and four alternative grid formats. The results indicated that participants' affirmative response tendency (i.e., judge the…

One of the main objectives of international large-scale assessments is to make comparisons between different countries, education policies, education systems, or subgroups. One of the main criteria for making comparisons between different groups is to ensure measurement invariance. The purpose of this study was to test the measurement invariance…