The 0.05 boundary within Null Hypothesis Statistical Testing (NHST) "has made a lot of people very angry and been widely regarded as a bad move" (to quote Douglas Adams). Here, we move past meta-scientific arguments and ask an empirical question: What is the psychological standing of the 0.05 boundary for statistical significance? We…

Using the Hartung-Knapp method and 95% prediction intervals (PIs) in random-effects meta-analyses is recommended by experts but rarely applied. Therefore, we aimed to reevaluate statistically significant meta-analyses using the Hartung-Knapp method and 95% PIs. In this methodological study, three databases were searched from January 2010 to July…

Mixed-effects models can be used to examine the association between a categorical moderator and the magnitude of the effect size. Two approaches are available to estimate the residual between-studies variance, t[superscript 2][subscript res] --namely, separate estimation within each category of the moderator versus pooled estimation across all…

The What Works Clearinghouse (WWC) seeks to provide practitioners information about "what works in education." One challenge in understanding "what works" is that effect sizes may not be comparable across studies, which limits the ability to compare the relative effectiveness of multiple interventions. One factor that…

Formal empirical assessments of replication have recently become more prominent in several areas of science, including psychology. These assessments have used different statistical approaches to determine if a finding has been replicated. The purpose of this article is to provide several alternative conceptual frameworks that lead to different…

Communication skills in pharmacy education and practice are increasingly regarded as a crucial component. However, thus far, estimating of the overall communication skills training (CST) effects in a variety of outcomes is lacking. The aim of this study was to synthesize the effects of CST in pharmacy education by performing a meta-analysis of CST…

"Shifting Sands: Unsound Science and Unsafe Regulation" examines how irreproducible science affects select areas of government policy and regulation governed by different federal agencies. This first report on "PM[subscript 2.5] Regulation" focuses on irreproducible research in the field of environmental epidemiology, which…

A concept map is a node-link diagram in which each node represents a concept and each link identifies the relationship between the two concepts it connects. We investigated how using concept maps influences learning by synthesizing the results of 142 independent effect sizes (n = 11,814). A random-effects model meta-analysis revealed that learning…

In this interview, we discuss my early uses of meta-analytic procedures, first to combine "p"-values and then to combine effect sizes as well. My interest in quantifying the magnitude and the statistical significance of the effect of interpersonal expectations probably grew out of the following: (1) a long-held interest in the concept of…

While there are many ways to author text today, writing with paper and pen (or pencil) is still quite common at home and work, and predominates writing at school. Because handwriting can bias readers' judgments about the ideas in a text and impact other writing processes, like planning and text generation, it is important to ensure students…

The paper focuses on the field of learning styles in e-learning. The study is structured in two main parts: (1) a brief overview of traditional approaches to learning styles is presented and their role in the process of instruction is set; this part results in the reflection of current state, when learning styles are considered within e-learning;…

Meta-analysis multiplicity, the concept of conducting multiple tests of statistical significance within one review, is an underdeveloped literature. We address this issue by considering how Type I errors can impact meta-analytic results, suggest how statistical power may be affected through the use of multiplicity corrections, and propose how…

Heterogeneity in meta-analysis is most commonly estimated using a moment-based approach described by DerSimonian and Laird. However, this method has been shown to produce biased estimates. Alternative methods to estimate heterogeneity include the restricted maximum likelihood approach and those proposed by Paule and Mandel, Sidik and Jonkman, and…

Engagement markers (hereafter, EMs) are crucial interpersonal devices to interact with readers through texts. However, little is known about the differences of EMs use in Humanities and Science journal research articles (hereafter, RAs), as well as the changes in markers use over the passage of time. The present study provides a quantitative and…

Publication bias is a term that typically refers to the well-known tendency for studies lacking statistically significant results to be less likely to be published in peer-reviewed journals. This happens because authors are less likely to submit, while editors and reviewers are less likely to accept for publication, papers that lack statistically…