Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a…

This study examines meta-analysis studies published in the field of educational sciences from 2010-2019, in journals indexed within the scope of the TÜBITAK ULAKBIM TR Directory. Of the 163 studies scanned, 26 meta-analysis studies that meet the inclusion criteria constitute the sample of this content analysis study. Within this research, a…

In an influential publication in 2009, a group of cognitive psychologists revealed that there was a lack of empirical evidence supporting the concept of learning styles-based instruction and provided guidelines for the type of research design necessary to verify the learning styles hypothesis. This article examined the literature since 2009 to…

Background: Homogeneity and consistency assumptions underlie network meta-analysis (NMA). Methods exist to assess the assumptions but they are rarely and poorly applied. We review and illustrate methods to assess homogeneity and consistency. Methods: Eligible articles focussed on indirect comparison or NMA methodology. Articles were sought by…

Among some gifted education researchers, advocates, and practitioners, it is sometimes believed that there is a larger number of gifted people in the general population than would be predicted from a normal distribution (e.g., Gallagher, 2008; N. M. Robinson, Zigler, & Gallagher, 2000; Silverman, 1995, 2009), a belief that we termed the…

Collaborative inquiry (CI) has emerged as a dominant structure for educators' professional learning in the 21st century. The purpose of this paper is to analyze publicly available documents and policies related to CI in Ontario in order to better understand the documentary scope and spread of this professional learning model in the province. We…

Three articles in this special issue explore issues related to the use and misuse of statistical significance testing, the major methodological issue in current educational research. Comments on these articles and rejoinders by the authors of the first three articles explore additional aspects of statistical significance testing. (SLD)

Expresses a "middle-of-the-road" position on statistical significance testing, suggesting that it has its place but that confidence intervals are generally more useful. Identifies 10 errors of omission or commission in the papers reviewed that weaken the positions taken in their discussions. (SLD)

The use of and emphasis on statistical significance testing has pervaded educational and behavioral research for many decades in spite of criticism by prominent researchers in this field. Much of the controversy is caused by lack of understanding or misinterpretations. This paper reviews criticisms of statistical significance testing and discusses…

Outlines concerns that must be addressed by those who advocate replacing statistical hypothesis-testing with alternative data-analysis strategies. Suggests that commonly recommended alternatives are not perfect and that various hypothesis-testing modifications can be implemented to make the process and its conclusions more credible. Hypothesis…

Proposing that most studies of nonverbal intimacy regulation have inadequately tested the compensation model (changes in any component of intimacy necessitate compensating changes in other components to maintain an equilibrium), this paper examines the nature of methodological problems in such studies and offers three suggestions for improved…

This article explores the potential of Bayesian inference as a theoretical framework for describing how people evaluate hypotheses. First, it identifies a set of logically possible forms of non-Bayesian behavior. Second, it reviews existing research in a variety of areas to see whether these possibilities are ever realized. (Author/BW)

This paper addresses the state of the art regarding the use of statistical significance tests (SSTs). How social science research will be conducted in the future is impacted directly by current debates regarding hypothesis testing. This paper: (1) briefly explicates the current debate on hypothesis testing; (2) reviews the newly published report…

Statistical methods, called latent variable models, have been developed to provide rigorous tests of theories involving unobserved variables. This paper describes the major types of latent variable models, shows how they can be applied in educational research, and gives representative examples of their use from the literature. (Author/BW)

Discusses the use of hypothesis testing research and hypothesis generating research designs. Researchers investigating teacher development should continue to use hypothesis generating research designs to depict, relate, and conceptualize information in this area. Hypothesis testing research designs could check the accuracy of these initial…