Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…

As traditionally conceived, publication bias arises from selection operating on a collection of individually unbiased estimates. A canonical form of such selection across studies (SAS) is the preferential publication of affirmative studies (i.e., those with significant, positive estimates) versus nonaffirmative studies (i.e., those with…

We conducted a multi-pronged investigation of different types of reporting bias in autism early childhood intervention research. First, we investigated the prevalence of reporting failures of completed trials registered on clinicaltrials.gov, and found that only 7% of registered trials were updated with results on the registration platform and…

We provide a novel characterization of augmented balancing weights, also known as automatic debiased machine learning (AutoDML). These popular "doubly robust" or "de-biased machine learning estimators" combine outcome modeling with balancing weights -- weights that achieve covariate balance directly in lieu of estimating and…

Mixed research is a methodology of growing importance both within and without education. This type of research forces researchers to reconcile conflicting ways of justifying and understanding research with results that have the potential to be forward pointing for all researchers. As mixed research has grown, mixed research has gained an…

Numerous articles and textbooks advise qualitative researchers on accessing "hard-to-reach" or "hidden" populations. In this article, I compare two studies that I conducted with justice-involved women in the United States: a yearlong ethnography inside a state women's prison and an interview study with formerly incarcerated…

Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…

Background: Power analyses for a cluster-randomized trial (CRT) require estimates of additional design parameters beyond those needed for an individually randomized trial. In a 2-level CRT, there are two sample sizes, the number of clusters and the number of individuals per cluster. The intraclass correlation (ICC), or the proportion of variance…

While previous work has highlighted the possible impacts of undertaking emotionally challenging research, it is only recently, particularly within the UK with the 2028 Research Excellence Framework focus on research culture, that this subject is starting to gain senior leadership attention. Funded by the UK Research and Innovation, Researcher…

This study examined the feasibility of conducting a follow-up survey of panel attriters as a panel maintenance measure to investigate respondents' reasons for attrition, assessing their willingness to rejoin, and updating their addresses. We surveyed FReDA panelists who had not participated in two consecutive subwaves and were excluded from the…

Indirect questioning techniques such as the randomized response technique aim to control social desirability bias in surveys of sensitive topics. To improve upon previous indirect questioning techniques, we propose the new Cheating Detection Triangular Model. Similar to the Cheating Detection Model, it includes a mechanism for detecting…

Insufficient effort responding (IER) refers to a lack of effort when answering survey or questionnaire items. Such items typically offer more than two ordered response categories, with Likert-type scales as the most prominent example. The underlying assumption is that the successive categories reflect increasing levels of the latent variable…

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to devasting effects on students, these disruptions had consequences for researchers conducting studies on education programs and policies. Given the likelihood of future large-scale disruptions, it is important for researchers to plan resilient studies and think critically…

Background/Context: Confirmatory factor analysis (CFA) model is a commonly adopted framework to estimate and test a measurement model. Once a well-fitting final CFA model is selected, the selected model may be used to test structural relationships of the latent constructs with other variables, to construct a test with desired reliability and…

In this article John Raven responds to commentaries on his article, "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions" (EJ1248321). Herein, he provides dialogues with individual authors that relate closely to his original theme and which seemed to merit further elaboration. He briefly addresses: (1)…