The Research-Aligned Mentorship (RAM) program at Farmingdale State College is changing the trajectories of racial minority students, students of low socioeconomic status, and first-generation undergraduate students. This article reviews the RAM program from 2016 through 2022. During that period, Farmingdale welcomed seven cohorts of RAM Scholars,…

Cluster-randomized trials have been widely used to evaluate the treatment effects of interventions on student outcomes. When interventions are implemented by teachers, researchers need to account for the nested structure in schools (i.e., students are nested within teachers nested within schools). Schools usually have a very limited number of…

Psychologists are emphasizing the importance of predictive conclusions. Machine learning methods, such as supervised neural networks, have been used in psychological studies as they naturally fit prediction tasks. However, we are concerned about whether neural networks fitted with random datasets (i.e., datasets where there is no relationship…

Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing…

This article provides an introduction to randomized response polling, a technique which was designed to allow for questioning on sensitive issues while protecting the respondent's privacy and avoiding social desirability bias. It is described in terms that are suitable for presentation and use in any classroom environment. Instructions for plain…

Increasing integrity concerns in medical research have prompted the development of tools to detect untrustworthy studies. Existing tools primarily assess published aggregate data (AD), though scrutiny of individual participant data (IPD) is often required to detect trustworthiness issues. Thus, we developed the IPD Integrity Tool for detecting…

Implementation of evidence-based practices for autistic students must be informed by robust research literature. Randomized-controlled trials (RCTs) are often considered a "gold standard" methodology for determining the effectiveness of interventions. However, the complex nature of schools presents challenges for implementing successful…

Little research has been conducted to assess which specific databases should be searched when performing a systematic review (SR) on acupuncture. The current study aimed to identify key databases and the optimal database combination to retrieve randomized controlled trials (RCTs) on acupuncture for inclusion in SRs. A systematic search for SRs in…

Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…

Background: Power analyses for a cluster-randomized trial (CRT) require estimates of additional design parameters beyond those needed for an individually randomized trial. In a 2-level CRT, there are two sample sizes, the number of clusters and the number of individuals per cluster. The intraclass correlation (ICC), or the proportion of variance…

Random encouragement designs evaluate treatments that aim to increase participation in a program or activity. These randomized controlled trials (RCTs) can also assess the mediated effects of participation itself on longer term outcomes using a complier average causal effect (CACE) estimation framework. This article considers power analysis…

Multisite cluster randomized trials (MCRTs), in which, the intermediate-level clusters (e.g., classrooms) are randomly assigned to the treatment or control condition within each site (e.g., school), are among the most commonly used experimental designs across a broad range of disciplines. MCRTs often align with the theory that programs are…

College attendance has increased significantly over the last few decades, but dropout rates remain high, with fewer than half of all adults ultimately obtaining a postsecondary credential. This project investigates whether one-on-one college coaching improves college attendance and completion outcomes for former low- and middle-income income state…

We investigated to which degree commercial funding is associated with estimated intervention effects in randomized trials. We included meta-epidemiological studies with published data on the association between commercial funding and results or conclusions of randomized trials. We searched five databases and other sources. We selected one result…

This paper introduces a simple, quotient effect size, termed (for 'quotient'), suitable for reporting on the effectiveness of educational interventions. The quotient effect size for a pre-test-post-test design is defined as the gain score (i.e. post-test minus pre-test) for the intervention group, divided by the gain score for the control group.…