Standard methods for the meta-analysis of medical tests, without assuming a gold standard, are limited to dichotomous data. Multivariate probit models are used to analyse correlated dichotomous data, and can be extended to model ordinal data. Within the context of an imperfect gold standard, they have previously been used for the analysis of…

To keep pace with medicine's unpredictable changes, medical trainees must learn to accurately monitor and evaluate themselves via metacognition (i.e., thinking about thinking). The Metacognitive Awareness Inventory (MAI) can assess and guide the metacognitive development of trainees. This study summarizes existing psychometric evidence and…

The purpose of this study was to estimate the overall reliability values for the scores produced by Runco Ideational Behavior Scale (RIBS) and explore the variability of RIBS score reliability across studies. To achieve this, a reliability generalization meta-analysis was carried out using the 86 Cronbach's alpha estimates obtained from 77 studies…

Over the past decade, meta-analyses have been conducted to evaluate the impact of embodied pedagogical agents on learning outcomes. Most review studies have evaluated learning outcomes from the perspective of testing labels such as transfer, retention, recognition, free recall, and various other classifications. This is problematic, because…

Making metamemory judgments reactively changes item memory itself. Here we report the first investigation of reactive influences of making judgments of learning (JOLs) on interitem relational memory--specifically, temporal (serial) order memory. Experiment 1 found that making JOLs impaired order reconstruction. Experiment 2 observed minimal…

This meta-analysis reviews 79 studies (N = 46,605) that examined the existence of gender difference on intelligence in school-aged children. To do so, we limited the literature search to works that assessed the construct of intelligence through the Wechsler Intelligence Scales for Children (WISC) batteries, evaluating eventual gender differences…

Numerous primary studies and a recent meta-analytic confirmatory factor analysis (Meta-CFA; Said-Metwaly, Fernández-Castilla, Kyndt, & Van den Noortgate, 2018) have shown that Torrance Tests of Creative Thinking -- Figural (TTCT-F) consists of two factors. However, recent research has raised questions regarding factor analysis of the TTCT-F…

The involvement load hypothesis (ILH) was designed to predict the effectiveness of instructional tasks for incidental L2 vocabulary learning. In this meta-analysis we examined 398 effect sizes from 42 empirical studies (N = 4,628) to explore (a) the overall predictive ability of the ILH, (b) the relative effects of different components of the ILH…

This meta-analysis aimed to clarify the complex relationship between repetition and second language (L2) incidental vocabulary learning by meta-analyzing primary studies reporting correlation coefficients between the number of encounters and vocabulary learning. We synthesized and quantitatively analyzed 45 effect sizes from 26 studies (N = 1,918)…

As online educational programs and courses increase (Allen & Seaman, [Allen, I. E., 2014]), it is important to understand the benefits and limitations of this delivery format when assessing students and when comparing learning outcomes. This article addresses the following two questions: (1) What are some of the best practices in assessing…

We performed a survey of meta-analyses of test performance to describe the evolution in their methods and reporting. Studies were identified through MEDLINE (1966-2009), reference lists, and relevant reviews. We extracted information on clinical topics, literature review methods, quality assessment, and statistical analyses. We reviewed 760…

This study examines (1) the effects of hypertext gloss use on L2 vocabulary acquisition in computerized reading contexts; (2) which specific combination of either text-only (single) or text + visual (multiple) hypertext glosses is more effective on L2 vocabulary acquisition; and (3) potential moderators to systematically account for between study…

The purpose of the present study was to meta-analytically investigate the score reliability for the Satisfaction With Life Scale. Four-hundred and sixteen articles using the measure were located through electronic database searches and then separated to identify studies which had calculated reliability estimates from their own data. Sixty-two…

Commencing in 1985, a small body of experimental studies on the effects of test taking on delayed retention learning of technical subject matter has been completed in technology education settings. Much of the learning in technology education courses, especially the hands-on aspects, are best assessed via instruments and techniques other than…

This project consisted of a meta-analysis of U.S. research published from 1980 to 2004 on the effect of specific science teaching strategies on student achievement. The six phases of the project included study acquisition, study coding, determination of intercoder objectivity, establishing criteria for inclusion of studies, computation of effect…