The 0.05 boundary within Null Hypothesis Statistical Testing (NHST) "has made a lot of people very angry and been widely regarded as a bad move" (to quote Douglas Adams). Here, we move past meta-scientific arguments and ask an empirical question: What is the psychological standing of the 0.05 boundary for statistical significance? We…

Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have used different statistical approaches to determine if a finding has been replicated. The purpose of this article is to provide several alternative conceptual frameworks that lead to different…

Heterogeneity in meta-analysis is most commonly estimated using a moment-based approach described by DerSimonian and Laird. However, this method has been shown to produce biased estimates. Alternative methods to estimate heterogeneity include the restricted maximum likelihood approach and those proposed by Paule and Mandel, Sidik and Jonkman, and…

The purpose of this study is both to gather the experimental studies which investigate the effect of creative drama on the attitudes of students towards the courses and to synthesize the findings of these studies. The studies within the scope of this current research were obtained from various databases such as "ProQuest Citations, Council of…

This study examined the impact of publication bias on a meta-analysis of empirical studies on validity of University Matriculation Examinations in Nigeria with a view to determine the level of difference between published and unpublished articles. Specifically, the design was an ex-post facto, a causal comparative design. The sample size consisted…

This dissertation entitled "Educational choice and educational space" aims to explore the confluence of constructed space and geographic space using a supply-side context for New Zealand's public school system of quasi-open enrollment. In Part I, New Zealand's state and state-integrated school system across four urban areas is analyzed…

Null hypothesis significance testing alone is not sufficient for program evaluation. To assess program impact adequately, effect sizes should be reported and interpreted in the context of similar or alternate programs. A popular effect size for the treatment-control group design has been the standardized mean difference, delta. Several estimators…

Power is an indicator of the ability of a statistical analysis to detect a phenomenon that does in fact exist. The issue of power is crucial for social science research because sample size, effects, and relationships studied tend to be small and the power of a study relates directly to the size of the effect of interest and the sample size.…

Reviews null hypothesis statistical significance testing (NHST) in its historical context and concludes that workable alternatives to NHST are available. Among suggested alternatives, effect magnitude measures, replication techniques, and meta-analytic techniques are discussed. (SLD)

The assumptions and consequences of applying conventional and newer statistical methods to meta-analytic data sets are reviewed. The application of the two approaches to a meta-analytic data set described by L. V. Hedges (1984) illustrates the differences. Hedges analyzed six studies of the effects of open education on student cooperation. The…

The use of statistical methods to combine the results of independent empirical research studies (metanalysis) has a long history, with work mainly divided into tests of the statistical significance of combined results and methods for combining estimates across studies. Methods of metanalysis and their applications are reviewed. (SLD)

Adherence to the arbitrary 0.05 level of significance as a benchmark for decisions about publishing research largely accounts for the popularity of one-tailed hypothesis tests. Effect size estimates, accompanied by confidence intervals or exact two-tailed probabilities, are generally more compatible with the growing meta-analytic view of social…

Data drawn from 30 journal articles and ERIC documents reporting on gender differences in natural science achievement were re-examined. Three meta-analysis methods were used: (1) vote counts and vote-counting estimation procedures; (2) tests of combined significance; and (3) analyses of effect sizes. The three methods produced seemingly…