The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

Despite the increasing implementation of formative assessment in medical education, its' effect on learning behaviour remains questionable. This effect may depend on how students value formative, and summative assessments differently. Informed by Expectancy Value Theory, we compared test preparation, feedback use, and test-taking motivation of…

Technology has become a fundamental means to encourage reliable and more effective assessments. Rapid technological developments have led to the widespread use of digital platforms and devices in all aspects of life. Educational institutions worldwide had to take advantage of this technological leap during pandemics such as COVID-19, which changed…

PISA aims to serve as a "global yardstick" for educational success, as measured by student performance. For comparisons to be meaningful across countries or over time, PISA samples must be representative of the population of 15-year-old students in each country. Exclusions and non-response can undermine this representativeness and…

Indirect indices for faking detection in questionnaires make use of a respondent's deviant or unlikely response pattern over the course of the questionnaire to identify them as a faker. Compared with established direct faking indices (i.e., lying and social desirability scales), indirect indices have at least two advantages: First, they cannot be…

This study examined the read-aloud accommodation benefits for students with disabilities (SWD) and students without disabilities (SWOD). In this study, researchers recommend ways in which to remove encumbrances faced by SWD in reading comprehension. In general, research has shown that both SWD and SWOD have met some degree of success from the…

Distance learning and online learning have become the new educational paradigm. Based on synchronicity, online learning environments can be classified into synchronous and asynchronous online learning. However, previous evidence demonstrating the effects of these two online learning modalities on students' academic achievement has been…

Phonological awareness plays a key role in learning to read; therefore, its assessment has received a lot of attention. Research in the domain of phonological awareness has been characterized by attempts to develop reliable and valid assessment tools for diverse populations. Over the past few decades, phonological awareness assessment has gone…

High school graduation is a meaningful indicator of student achievement and a stronger predictor of long-term quality of life outcomes compared to student test scores. The existing body of research has been limited on whether charter attendance improves high school graduation and whether charter attendance helps narrow the graduation gap among…

We evaluate the predictive validity of the Massachusetts Candidate Assessment of Performance (CAP), a practice-based assessment of teaching skills that is now a requirement for teacher preparation program completion in Massachusetts. We find that candidates' performance on the CAP significantly predicts their in-service summative performance…

Test score comparability in international large-scale assessments (LSA) is of utmost importance in measuring the effectiveness of education systems and understanding the impact of education on economic growth. To effectively compare test scores on an international scale, score linking is widely used to convert raw scores from different linguistic…

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated in large-scale administration; and second, the degree to which online and paper assessments offer different information about underlying student…

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated; and second, the degree to which online and paper assessments offer different information about underlying student ability. We first find very small…

In data collected from virtual learning environments (VLEs), item response theory (IRT) models can be used to guide the ongoing measurement of student ability. However, such applications of IRT rely on unbiased item parameter estimates associated with test items in the VLE. Without formal piloting of the items, one can expect a large amount of…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…