Meta-analyses can be compromised by studies' internal biases (e.g., confounding in nonrandomized studies) as well as publication bias. These biases often operate nonadditively: publication bias that favors significant, positive results selects indirectly for studies with more internal bias. We propose sensitivity analyses that address two…

Data donation is a novel approach to collecting digital trace data, where users are asked to download their retrospective data from a platform and share them with the researchers. Little is known about the willingness to donate data and the potential bias that may arise from nonparticipation. We conducted a study among over 900 German Facebook…

Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…

In network meta-analysis (NMA), we synthesize all relevant evidence about health outcomes with competing treatments. The evidence may come from randomized clinical trials (RCT) or non-randomized studies (NRS) as individual participant data (IPD) or as aggregate data (AD). We present a suite of Bayesian NMA and network meta-regression (NMR) models…

Solving problems in educational settings, as in daily-life scenarios, involves constantly assessing one's own confidence in each considered solution. Metacognitive research has exposed cues that may bias confidence judgments (e.g., familiarity with question terms). Typically, metacognitive research methodologies require examining misleading cues…

This paper aims to explore the philosophical theoretical foundations of two basic research paradigms, namely positivism and interpretivism. In the discussion process, literature in the relevant fields including academic papers and books is reviewed and used as support for the analysis. Firstly, the paper explores the differences between the…

This article examines an important and thorny problem in interview research: How to assess whether what people say motivated their actions actually did so? We ask three questions: What specific challenges are at play? How have researchers addressed them? And how should those strategies be evaluated? We argue that such research faces at least five…

In order to produce the most reliable syntheses of the effectiveness of educational interventions, systematic reviews need to adhere to rigorous methodological standards. This meta-review investigated risk of bias occurring while conducting a systematic review and the presence of open science practices like data sharing and reproducibility of the…

Background: Systematic reviews and meta-analyses of interventions can provide critical evidence for educators and policymakers by providing insights into the effectiveness of related interventions. The quality of included studies builds the foundation for a high-quality review, while bias in the included studies increases the risks of unreliable…

Publication bias is a well-known threat to the validity of meta-analyses and, more broadly, the reproducibility of scientific findings. When policies and recommendations are predicated on an incomplete evidence base, it undermines the goals of evidence-based decision-making. Great strides have been made in the last 50 years to understand and…

Children's development of executive function is a good candidate for studying cultural differences because it is a necessary capacity for becoming competent participants in cultural activities, and yet it is also likely to be shaped by culturally organized everyday experiences, with potential consequences for children's development and learning.…

Our purpose in this article is to examine the subjective processes of researchers while becoming conscious during the investigation of infants and toddlers (I/Ts) in educational settings. Based on the intertwining between Cultural-historical Psychology and Ethnography in Education, we followed a group of I/Ts at a Brazilian Early Childhood…

Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we…

It is important to be able to identify research results likely to have been arrived at by means of "'p'-hacking," a common term for research and reporting practices (such as the selective reporting of results) that are biased toward finding "p" < [alpha]. This paper discusses and demonstrates "'p'-curving," a means…

A "P" value, or the magnitude or direction of results can influence decisions about whether, when, and how research findings are disseminated. Regardless of whether an entire study or a particular study result is unavailable because investigators considered the results to be unfavorable, bias in a meta-analysis may occur when available…