We consider estimating the effect of a treatment on a given outcome measured on subjects tested both before and after treatment assignment in observational studies. A vast literature compares the competing approaches of modelling the post-test score conditionally on the pre-test score versus modelling the difference, namely, the gain score. Our…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

This article presents the results of a study of academic e-books that compared the metadata and search results from major academic e-book platforms. The authors collected data and performed a series of test searches designed to produce the same result regardless of platform. Testing, however, revealed metadata-related errors and significant…

In this study, we examined the potential impact of item misfit on the reported scores of an admission test from the subpopulation invariance perspective. The target population of the test consisted of 3 major subgroups with different geographic regions. We used the logistic regression function to estimate item parameters of the operational items…

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong…

In this study, we investigated whether incorporating eye tracking into cognitive interviewing is effective when pretesting survey questions. In the control condition, a cognitive interview was conducted using a standardized interview protocol that included pre-defined probing questions for about one-quarter of the questions in a 52-item…

Maintaining score interchangeability and scale consistency is crucial for any testing programs that administer multiple forms across years. The use of a multiple linking design, which involves equating a new form to multiple old forms and averaging the conversions, has been proposed to control scale drift. However, the use of multiple linking…

A series of short (5 to 7 minutes long) geoscience videos were created to support student learning in a flipped class setting for an introductory geology class at North Carolina State University. Videos were made using a stylus, tablet, microphone, and video editing software. Essentially, we narrate a slide, sketch a diagram, or explain a figure…

Not much is known about how people comprehend ironic utterances, and to date, most studies have simply compared processing of ironic versus non-ironic statements. A key aspect of the graded salience hypothesis, distinguishing it from other accounts (such as the standard pragmatic view and direct access view), is that it predicts differences…

Factors external and internal to social work practice have caused our profession to question its role and identity. The emergence of evidence-based or evidenced informed practices forces the profession to reexamine its unique identity and its historical roots. This article addresses the problems in the dominant paradigm guiding our profession, the…

This study evaluated an intervention package combining simple and conditional discrimination training and specific reinforcement for each stimulus class in teaching reading of simple words to individuals with intellectual disabilities. In conditional discrimination training, participants matched printed words and pictures to the recorded sounds…

Group awareness can affect student online learning while self-regulation also can substantially influence student online learning. Although some studies identify that these two variables may partially determine learning behavior, few empirical studies or thorough analyses elucidate the simultaneous impact of these two variables (group awareness…

This study explores the effectiveness of integrating morphological instruction within comprehension strategy instruction. Participants were 203 students (N = 117 fifth-grade; 86 sixth-grade) from four urban schools who were randomly assigned to the intervention (N = 110; morphological problem-solving within comprehension strategy instruction) or…