Practice testing is a powerful tool to consolidate long-term retention of studied information, facilitate subsequent learning of new information, and foster knowledge transfer. However, practitioners frequently express the concern that tests are anxiety-inducing and that their employment in the classroom should be minimized. The current review…

Standard methods for the meta-analysis of medical tests, without assuming a gold standard, are limited to dichotomous data. Multivariate probit models are used to analyse correlated dichotomous data, and can be extended to model ordinal data. Within the context of an imperfect gold standard, they have previously been used for the analysis of…

To keep pace with medicine's unpredictable changes, medical trainees must learn to accurately monitor and evaluate themselves via metacognition (i.e., thinking about thinking). The Metacognitive Awareness Inventory (MAI) can assess and guide the metacognitive development of trainees. This study summarizes existing psychometric evidence and…

The purpose of this study was to estimate the overall reliability values for the scores produced by Runco Ideational Behavior Scale (RIBS) and explore the variability of RIBS score reliability across studies. To achieve this, a reliability generalization meta-analysis was carried out using the 86 Cronbach's alpha estimates obtained from 77 studies…

Over the past decade, meta-analyses have been conducted to evaluate the impact of embodied pedagogical agents on learning outcomes. Most review studies have evaluated learning outcomes from the perspective of testing labels such as transfer, retention, recognition, free recall, and various other classifications. This is problematic, because…

Making metamemory judgments reactively changes item memory itself. Here we report the first investigation of reactive influences of making judgments of learning (JOLs) on interitem relational memory--specifically, temporal (serial) order memory. Experiment 1 found that making JOLs impaired order reconstruction. Experiment 2 observed minimal…

Knowledge is an important predictor and outcome of learning and development. Its measurement is challenged by the fact that knowledge can be integrated and homogeneous, or fragmented and heterogeneous, which can change through learning. These characteristics of knowledge are at odds with current standards for test development, demanding a high…

This meta-analysis reviews 79 studies (N = 46,605) that examined the existence of gender difference on intelligence in school-aged children. To do so, we limited the literature search to works that assessed the construct of intelligence through the Wechsler Intelligence Scales for Children (WISC) batteries, evaluating eventual gender differences…

Numerous primary studies and a recent meta-analytic confirmatory factor analysis (Meta-CFA; Said-Metwaly, Fernández-Castilla, Kyndt, & Van den Noortgate, 2018) have shown that Torrance Tests of Creative Thinking -- Figural (TTCT-F) consists of two factors. However, recent research has raised questions regarding factor analysis of the TTCT-F…

Feedback is one of the most important factors for successful learning. Contemporary computer-based learning and testing environments allow the implementation of automated feedback in a simple and efficient manner. Previous meta-analyses suggest that different types of feedback are not equally effective. This heterogeneity might depend on learner…

This systematic review investigated the topics studied and reporting practices of published meta-analyses in educational measurement. Our findings indicated that meta-analysis is not a highly utilized methodological tool in educational measurement; on average, less than one meta-analysis has been published per year over the past 30 years (28…

The use of accommodations is often recommended to remove barriers to academic testing among English Learners (ELs). However, it is unclear whether accommodations are particularly effective at improving ELs' test scores. A growing foundation of empirical work has explored this topic. We conducted a meta-analysis that examined several possible…

With the availability of low-cost high-quality head-mounted displays (HMDs) since 2013, there is a growing body of literature investigating the impact of immersive virtual reality (IVR) technology on education. This meta-analysis aims to synthesize the findings on the overall effects of IVR using HMDs compared to less immersive desktop virtual…

The involvement load hypothesis (ILH) was designed to predict the effectiveness of instructional tasks for incidental L2 vocabulary learning. In this meta-analysis we examined 398 effect sizes from 42 empirical studies (N = 4,628) to explore (a) the overall predictive ability of the ILH, (b) the relative effects of different components of the ILH…

This meta-analysis aimed to clarify the complex relationship between repetition and second language (L2) incidental vocabulary learning by meta-analyzing primary studies reporting correlation coefficients between the number of encounters and vocabulary learning. We synthesized and quantitatively analyzed 45 effect sizes from 26 studies (N = 1,918)…