Social desirability bias (SDB) is a common threat to the validity of conclusions from responses to a scale or survey. There is a wide range of person-fit statistics in the literature that can be employed to detect SDB. In addition, machine learning classifiers, such as logistic regression and random forest, have the potential to distinguish…

Differential item functioning (DIF) of test items should be evaluated using practical methods that can produce accurate and useful results. Among a plethora of DIF detection techniques, we introduce the new "Residual DIF" (RDIF) framework, which stands out for its accessibility without sacrificing efficacy. This framework consists of…

Causal inference involves determining whether a treatment (e.g., an education program) causes a change in outcomes (e.g., academic achievement). It is well-known that causal effects are more challenging to estimate than associations. Over the past 50 years, the potential outcomes framework has become one of the most widely used approaches for…

Progress monitoring using curriculum-based measures administered to a student at multiple points in time is common in educational settings. Recent research has demonstrated that common approaches to identifying individuals in need of special services, such as the trend line or median techniques, can be negatively impacted by the nonlinear change…

Early alert systems are an intervention at community colleges that aim to identify and informally intervene with students who are struggling in their courses. This study examined the relationship between early alert systems and student success in developmental and gateway math courses. This study also examined if the impact of early alert…

In seeking to close equity gaps within a first-year student seminar course, course designers leveraged emerging research on intrapersonal competency cultivation, known to significantly predict student success across diverse students (NAS, 2018). After re-designing the course to intentionally cultivate specific intrapersonal competencies,…

The assessment of screening accuracy and setting of cut points for a universal screener have traditionally been evaluated using logistic regression analysis. This analytic technique has been frequently used to evaluate the trade-offs in correct classification with misidentification of individuals who are at risk of performing poorly on a later…

In this article we present a general approach not relying on item response theory models (non-IRT) to detect differential item functioning (DIF) in dichotomous items with presence of guessing. The proposed nonlinear regression (NLR) procedure for DIF detection is an extension of method based on logistic regression. As a non-IRT approach, NLR can…

This study capitalizes on the performance identification system under the No Child Left Behind waivers to estimate the school-level impact of just missing formal state recognition as a high-performing school. Using a fuzzy regression-discontinuity design and data from the early years of waiver implementation in Rhode Island, we find that, when…

Observational studies are common in educational research, where subjects self-select or are otherwise non-randomly assigned to different interventions (e.g., educational programs, grade retention, special education). Unbiased estimation of a causal effect with observational data depends crucially on the assumption of ignorability, which specifies…

Background: Identifying reading comprehension difficulties is challenging. There are many comprehension tests to choose from, and a child's diagnosis can be influenced by various factors such as a test's format and content and the choice of diagnostic criteria. We investigate these issues with reference to the Neale Analysis of Reading Ability…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

We synthesized empirical work to evaluate whether Black children are disproportionately overrepresented in special education. We identified 22 studies that met a priori inclusion criteria including use of at least 1 covariate in the reported analyses. Evidence of overrepresentation declined markedly as the studies included one or more of 3…

Realistic response rate expectations are important for successfully allocating and managing data collection efforts under limited resources. Interviewer performance is often evaluated against response rate standards, and face-to-face interviewer performance can vary due to, in part, the socioeconomic characteristics of the neighborhoods in which…

Bilingualism has been associated with a range of cognitive and language-related advantages, including the recognition that words can have different labels across languages. However, most previous research has failed to consider heterogeneity in the linguistic environments of children categorized as monolingual. Our study assessed the influence of…