We consider estimating the effect of a treatment on a given outcome measured on subjects tested both before and after treatment assignment in observational studies. A vast literature compares the competing approaches of modelling the post-test score conditionally on the pre-test score versus modelling the difference, namely, the gain score. Our…

This paper investigated consequences of measurement error in the pretest on the estimate of the treatment effect in a pretest-posttest design with the analysis of covariance (ANCOVA) model, focusing on both the direction and magnitude of its bias. Some prior studies have examined the magnitude of the bias due to measurement error and suggested…

In spring 2016, a course at Ohio State University (OSU) was introduced to teach advanced agronomic concepts and included the option to prepare students for the Certified Crop Adviser (CCA) exams offered by the American Society of Agronomy. From 2019 to 2021, revisions in instructional methods were implemented that introduced the use of pretests…

Retrospective pretests ask respondents to report after an intervention on their aptitudes, knowledge, or beliefs before the intervention. A primary reason to administer a retrospective pretest is that in some situations, program participants may over the course of an intervention revise or recalibrate their prior understanding of program content,…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

In this study, we examined the potential impact of item misfit on the reported scores of an admission test from the subpopulation invariance perspective. The target population of the test consisted of 3 major subgroups with different geographic regions. We used the logistic regression function to estimate item parameters of the operational items…

Relating mathematical concepts to graphical representations is a challenging task for students. In this paper, we introduce two visual strategies to qualitatively interpret the divergence of graphical vector field representations. One strategy is based on the graphical interpretation of partial derivatives, while the other is based on the flux…

Finding ways to improve student success in calculus is a critically important step on the path to supporting students who are pursuing degrees in STEM fields. Far too many students fail calculus 1 and are pushed to drop their majors in technical fields. One way of addressing this issue is by following a program that was pioneered at University of…

The leadership capacity of resident assistants can be impacted by many experiences, including involvement in mentoring relationships. The purpose of this study was to examine if and how resident assistants' leadership capacities are influenced by participating in mentoring relationships. Additionally, mentor-protégé race and gender pairings were…

The authors empirically examined whether the validity of a residualized dependent variable after covariance adjustment is comparable to that of the original variable of interest. When variance of a dependent variable is removed as a result of one or more covariates, the residual variance may not reflect the same meaning. Using the pretest-posttest…

This study was designed to assess the impact of a decision-making curriculum (PEER-DM) on the social peer relationship knowledge and self-protective decision-making skills of adolescents with disabilities in hypothetical situations involving negative peer pressure. A randomized design was used to assign students with disabilities from…

Neuroanatomy is one of the most challenging subjects in anatomy, and novice students often experience difficulty grasping the complex three-dimensional (3D) spatial relationships. This study evaluated a 3D neuroanatomy e-learning module, as well as the relationship between spatial abilities and students' knowledge in neuroanatomy. The study's…

This study explores the effectiveness of integrating morphological instruction within comprehension strategy instruction. Participants were 203 students (N = 117 fifth-grade; 86 sixth-grade) from four urban schools who were randomly assigned to the intervention (N = 110; morphological problem-solving within comprehension strategy instruction) or…