The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

Teachers occasionally express anger towards their students, and while some studies suggested it could enhance learning, others argued the opposite. We examined how teachers' anger affects junior high school students' learning performance. In Study 1, we surveyed 225 students using vignettes and discovered that when teachers displayed anger,…

The paper reports a qualitative study to reveal how preservice science teachers' decision making (DM) processes on socioscientific issue (SSI) in a referendum case compare between unsophisticated (Group U) and sophisticated (Group S) views in terms of nature of science (NOS) understandings. Firstly, pre-study was conducted with focus group…

In order to evaluate the effect of a policy or treatment with pre- and post-treatment outcomes, we propose an approach based on a transition model, which may be applied with multivariate outcomes and accounts for unobserved heterogeneity. This model is based on potential versions of discrete latent variables representing the individual…

The discussion on the role of American Sign Language (ASL) in deaf students' reading development has been long and contentious. The students' limited knowledge of English has been commonly perceived as a culprit in making reading difficult. However, a more nuanced explanation of reading performance and its relationship with competence in ASL's…

Background: The existence of a multiplier, compositional or social context effect is debated extensively in the literature on school effectiveness and also relates to the wider issue of equity in educational outcomes. However, comparatively little attention has been given to whether or not the association between student achievement and school…

This paper analyzes the relationship between proportional reasoning and understanding fair games in Costa Rican students. We conducted a quantitative and qualitative analysis of the answers to six items on comparing ratios of increasing difficulty level and another item on prize estimation in a fair game. We describe the strategies employed and…

In educational and psychological research, we are often interested in discrete latent states of individuals responding to an assessment (e.g., proficiency or non-proficiency on educational standards, the presence or absence of a psychological disorder). Diagnostic classification models (DCMs; also called cognitive diagnostic models [CDMs]) are a…

The purpose of this study was to compare the functioning of five restrictive CDMs, including DINA, DINO, A-CDM, LLM, and RRUM, against the G-DINA model to identify the best-fitting CDM which can better explain the interaction underlying the attributes of the reading comprehension section of an Iranian high-stakes language proficiency test. To this…

Most current statistics courses include some instruction relevant to causal inference. Whether this instruction is incorporated as material on randomized experiments or as an interpretation of associations measured by correlation or regression coefficients, the way in which this material is presented may have important implications for…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

This study explores how young children infer nuances in epistemic modality through prosody. A forced-choice task was used, testing children's (ages three to seven) comprehension of the "might"/"will" distinction (modal condition) as well their ability to modulate the strength of "might" through two prosodic tunes…

Agent-based modeling holds great potential as an analytical tool. Agent-based models (ABMs) are, however, also vulnerable to critique, as they often employ stylized social worlds, with little connection to the actual environment in question. Given these concerns, there has been a recent call to more fully incorporate empirical data into ABMs. This…

A guide for professional counselors and counseling researchers for calculating and interpreting Percent Improvement as an indicator of clinical significance is provided. Strategies for reporting findings are described and illustrated. Guidelines for contextualizing discussions of clinical significance within the boundaries of psychometric evidence…