Rapid approaches are essential when resources are limited and when findings are required in real-time to inform decisions. Limitations exist in their design and implementation, which can lead to a reduced level of trust in findings. This review sought to map the methods used across rapid evaluations and research to facilitate timeliness and…

School leadership research literature has a large number of widely used constructs. Could fewer constructs bring more clarity? This study evaluates construct content validity, defined as the extent to which a measure's items reflect a theoretical content domain, in school leadership literature. To do so, we reviewed 29 articles that used Teaching…

Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…

This paper presents a systematic literature review characterizing the methodological properties of usability studies conducted on educational and learning technologies in the past 20 years. PRISMA guidelines were followed to identify, select, and review relevant research and report results. Our rigorous review focused on (1) categories of…

There is increased use of Bayesian networks (BN) in educational assessment. In psychometrics, BN serves as a measurement model with high flexibility, suitable to model educational assessment data with a complex structure. BN is a novel psychometric approach and not all aspects of its application are well-known. The article aims to provide the…

School choice programs continue to be controversial, spurring a number of researchers into evaluating them. When possible, researchers evaluate the effect of attending a school of choice using randomized designs to eliminate possible selection bias. Randomized designs are often thought of as the gold standard for research, but many circumstances…

Historically, the synthesis of single subject design has employed visual inspection to yield significance of results. However, current research is supporting different techniques that will facilitate the interpretation of these intervention outcomes. These methods can provide more reliable data than employing visual inspection in isolation. This…

To explain country differences in an analytical or structural dependent variable, the application of a macro-micro-model containing contextual hypotheses is necessary. Our methodological study examines whether empirical studies apply such a model. We propose that a theoretical base for country differences is well described in multilevel studies,…

Today, nearly forty years after writing centers first began to proliferate, it is worthwhile to reflect on the themes that emerge from empirical material surrounding writing center assessments, for reflecting on these themes may help administrators to refine current assessment practices and scholars to redirect their research. The goal of this…

The subliminal psychodynamic activation method (SPA), used in testing psychoanalytic propositions, has been subject to recent criticisms regarding methodological weaknesses. A review of the literature relating to this method can be helpful in determining the validity of these criticisms and the potential usefulness of the SPA method in testing…

This article reviews the agricultural research evaluation literature in an effort to assess the extent of coverage in this area. Coverage breakdowns with respect to evaluation approaches, types of research, and products and production processes are presented. Results suggest that there has been limited coverage of research undertaken in…

A conceptualization of generalization and its place in educational research is proposed. Problems with existing approaches to generalization include limited concepts, misleading or simplistic results, perception variance or change, and the discouragement of sensitivity due to convenience. Researchers should distinguish between conclusions which…

Practical advice on frequently asked questions dealing with research and evaluation methodology is presented as rules of thumb, with citations to the author's sources. A statement in the literature is considered a rule of thumb if it meets one of the following criteria: (1) it is specifically called a rule of thumb; (2) it contains numbers in…

Since Shapiro's introduction of Eye Movement Desensitization and Reprocessing (EMDR) in 1989, it has been a highly controversial therapeutic technique. Critical reviews of Shapiro's initial study have highlighted many methodological shortcomings in her work. And early empirical research that followed Shapiro's original study has been criticized…

An evaluation of open education was shown to produce misleading results due to probable regression phenomena. These questionable results are now spread throughout the literature of education, sociology, and psychology. Researchers are advised to review, not merely summarize, prior articles. (Author/PN)