We consider estimating the effect of a treatment on a given outcome measured on subjects tested both before and after treatment assignment in observational studies. A vast literature compares the competing approaches of modelling the post-test score conditionally on the pre-test score versus modelling the difference, namely, the gain score. Our…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

This article presents the results of a study of academic e-books that compared the metadata and search results from major academic e-book platforms. The authors collected data and performed a series of test searches designed to produce the same result regardless of platform. Testing, however, revealed metadata-related errors and significant…

In this study, we examined the potential impact of item misfit on the reported scores of an admission test from the subpopulation invariance perspective. The target population of the test consisted of 3 major subgroups with different geographic regions. We used the logistic regression function to estimate item parameters of the operational items…

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong…

In this study, we investigated whether incorporating eye tracking into cognitive interviewing is effective when pretesting survey questions. In the control condition, a cognitive interview was conducted using a standardized interview protocol that included pre-defined probing questions for about one-quarter of the questions in a 52-item…

A series of short (5 to 7 minutes long) geoscience videos were created to support student learning in a flipped class setting for an introductory geology class at North Carolina State University. Videos were made using a stylus, tablet, microphone, and video editing software. Essentially, we narrate a slide, sketch a diagram, or explain a figure…

Factors external and internal to social work practice have caused our profession to question its role and identity. The emergence of evidence-based or evidenced informed practices forces the profession to reexamine its unique identity and its historical roots. This article addresses the problems in the dominant paradigm guiding our profession, the…

Group awareness can affect student online learning while self-regulation also can substantially influence student online learning. Although some studies identify that these two variables may partially determine learning behavior, few empirical studies or thorough analyses elucidate the simultaneous impact of these two variables (group awareness…

This study explores the effectiveness of integrating morphological instruction within comprehension strategy instruction. Participants were 203 students (N = 117 fifth-grade; 86 sixth-grade) from four urban schools who were randomly assigned to the intervention (N = 110; morphological problem-solving within comprehension strategy instruction) or…

Few studies have investigated the effects of the instructions provided in educational computer games on cognitive processing and learning outcomes. In our experiment, we sought to compare the effects on learning outcomes of two different types of goal-oriented instructions: "mastery-goal" instructions, which prompt learners to develop…