In this study, it was aimed to examine the effect of missing data in different patterns and sizes on test equating methods under the NEAT design for different factors. For this purpose, as part of this study, factors such as sample size, average difficulty level difference between the test forms, difference between the ability distribution,…

This paper presents a systematic literature review characterizing the methodological properties of usability studies conducted on educational and learning technologies in the past 20 years. PRISMA guidelines were followed to identify, select, and review relevant research and report results. Our rigorous review focused on (1) categories of…

Refutation texts, rhetorical tools designed to reduce misconceptions, have garnered attention across four decades and many studies. Yet, the ability of a refutation text to change a learner's mind on a topic needs to be qualified and modulated. In this critical review, we bring attention to sources of constraints often overlooked by refutation…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

Correspondence testing to research discrimination in the marketplace has become common and the use of internet applications has allowed researchers to send greater numbers of applications. While questions of research ethics always arise when planning a correspondence test, the issue receives relatively little attention in published correspondence…

This brief paper introduces a new approach to assessing the trustworthiness of research comparisons when expressed numerically. The 'number needed to disturb' a research finding would be the number of counterfactual values that can be added to the smallest arm of any comparison before the difference or 'effect' size disappears, minus the number of…

Van Gog and Sweller (2015) claim that there is no testing effect--no benefit of practicing retrieval--for complex materials. We show that this claim is incorrect on several grounds. First, Van Gog and Sweller's idea of "element interactivity" is not defined in a quantitative, measurable way. As a consequence, the idea is applied…

Background: The Education Endowment Foundation (EEF) is an independent charity that was established in 2011 with the explicit aim of breaking the link between family income and educational achievement in England. Over the seven years since its inception, EEF has contributed to the existing evidence base by funding over one hundred randomised…

Over the past ten years, the analytic formation of the school to prison pipeline has come to dominate the lexicon and general common sense with respect to the relationship between schools and prisons in the United States. The concept and theorization that undergirds its meaning and function do not address the root causes that are central to…

Many methods exist for imputing missing data but fewer methods have been proposed to test the missing data mechanism. Little (1988) introduced a multivariate chi-square test for the missing completely at random data mechanism (MCAR) that compares observed means for each pattern with expectation-maximization (EM) estimated means. As an alternative,…

In this article, the history of linking is summarized, and current linking frameworks that have been proposed are considered. Key publications discussed include Flanagan (1951), Angoff (1971), Linn (1993), Mislevy (1992), and Feuer, Holland, Green, Bertenthal, and Hemphill (1999). The article further focuses on the concordance situation for…

This paper shows that so-called "threshold concepts" have been defined in a way that makes it impossible, even in principle, to empirically isolate them. It continues by proposing an alternative theoretical framework, and argues: (1) that concepts are not reducible to abilities; (2) that acquisition of a given concept can be necessary, but not…

A number of organizational, personal and methodological characteristics have been identified through the literature which inhibit or can be used to facilitate the use of evaluation and testing information. Inhibitors of information usage include organizational characteristics such as loosely coupled and decentralized systems, personal…

Differences in 164 fifth grade students' reading comprehension scores were obtained with four different tasks typically used to measure comprehension (multiple choice, recall, cloze, and maze), using four different reading passages that were equated according to readability formulas. Data analyses revealed significant effects for passage, task,…

The use of a university exam to test the effects of ESP produced essentially overlapping distributions of performances by the experimental and control groups. (Author/KM)