Word-problem features such as text complexity, charts and graphs, position of the unknown, calculation complexity, irrelevant information, and schemas impact word-problem performance. We compared the word-problem performance of typically achieving (TA) students and students with mathematics difficulty (MD). First, we measured the word-problem…

We provide a novel characterization of augmented balancing weights, also known as automatic debiased machine learning (AutoDML). These popular "doubly robust" or "de-biased machine learning estimators" combine outcome modeling with balancing weights -- weights that achieve covariate balance directly in lieu of estimating and…

Developmental researchers commonly utilize longitudinal data to decompose reciprocal and dynamic associations between repeatedly measured constructs to better understand the temporal precedence between constructs. Although the cross-lagged panel model (CLPM) is commonly used in developmental research, it has been criticized for its potential to…

Bayesian approach is becoming increasingly important as it provides many advantages in dealing with complex data. However, there is no well-defined model selection criterion or index in a Bayesian context. To address the challenges, new indices are needed. The goal of this study is to propose new model selection indices and to investigate their…

Large Language Models (LLMs) hold promise as dynamic instructional aids. Yet, it remains unclear whether LLMs can replicate the adaptivity of intelligent tutoring systems (ITS)--where student knowledge and pedagogical strategies are explicitly modeled. We propose a prompt variation framework to assess LLM-generated instructional moves' adaptivity…

In Bayesian statistics, the most widely used criteria of Bayesian model assessment and comparison are Deviance Information Criterion (DIC) and Watanabe-Akaike Information Criterion (WAIC). A multilevel mediation model is used as an illustrative example to compare different types of DIC and WAIC. More specifically, the study compares the…

Composite scores are an exceptionally important psychometric tool for behavioral science research applications. A prototypical example occurs with self-report data, where researchers routinely use questionnaires with multiple items that tap into different features of a target construct. Item-level missing data are endemic to composite score…

In this brief, we outline the five components of the ISLA model, as well as steps that school and district teams can take to begin implementing these practices within their positive behavioral interventions and supports (PBIS) framework. Key Takeaways: (1) The ISLA model was created to support teachers, staff, and students by focusing on…

In standard statistical data analysis, the effects of intervention or prevention efforts are evaluated in terms of variable relations. Results from application of regression-type methods suggest whether, overall, intervention is successful. In this article, we propose using configural frequency analysis (CFA) either in tandem with regression-type…

Missing data are exceedingly common across a variety of disciplines, such as educational, social, and behavioral science areas. Missing not at random (MNAR) mechanism where missingness is related to unobserved data is widespread in real data and has detrimental consequence. However, the existing MNAR-based methods have potential problems such as…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

The strategy choice model (SCM) is a highly influential theory of human problem-solving. One strength of this theory is the allowance for both item and person variance to contribute to problem-solving outcomes, but this central tenet of the model has not been empirically tested. Explanatory item response theory (EIRT) provides an ideal approach to…

To construct dialogue-based Intelligent Tutoring Systems (ITS) with sufficient pedagogical expertise, a trendy research method is to mine large-scale data collected by existing dialogue-based ITS or generated between human tutors and students to discover effective tutoring strategies. However, most of the existing research has mainly focused on…

Many youth experience mental health problems. Schools are an ideal setting to identify, prevent, and intervene in these problems. The purpose of this study was to investigate patterns of student social, emotional, and behavioral risk over time among a community sample of 3rd through 12th grade students and the association of these risk patterns…

Investigators often rely on the proportion of correct responses in an assessment when describing the impact of early mathematics interventions on child outcomes. Here, we propose a shift in focus to the relative sophistication of problem-solving strategies and offer methodological guidance to researchers interested in working with strategies. We…