Researchers face many choices when conducting large-scale multisite individually randomized control trials. One of the most common quantities of interest in multisite RCTs is the overall average effect. Even this quantity is non-trivial to define and estimate. The researcher can target the average effect across individuals or sites. Furthermore,…

Educational assessment tests are designed to measure the same psychological constructs over extended periods. This feature is important considering that test results are often used for admittance to university programs. To ensure fair assessments, especially for those whose results weigh heavily in selection decisions, it is necessary to collect…

This Monte Carlo study assessed Type I error in differential item functioning analyses using Lord's chi-square (LC), Likelihood Ratio Test (LRT), and Mantel-Haenszel (MH) procedure. Two research interests were investigated: item response theory (IRT) model specification in LC and the LRT and continuity correction in the MH procedure. This study…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly common in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

Mixture IRT models address the heterogeneity in a population by extracting latent classes and allowing item parameters to vary between latent classes. Once the latent classes are extracted, they need to be further examined to be characterized. Some approaches have been adopted in the literature for this purpose. These approaches examine either the…

Conventional approaches for selecting a reference indicator (RI) could lead to misleading results in testing for measurement invariance (MI). Several newer quantitative methods have been available for more rigorous RI selection. However, it is still unknown how well these methods perform in terms of correctly identifying a truly invariant item to…

As the demand for skilled data scientists has grown, university level statistics and data science courses have become more rigorous in training students to understand and utilize the tools that their future careers will likely require. However, the mechanisms to assess students' use of these tools while they are learning to use them are not well…

This tool is intended to support state and local education agencies in developing a statistical model for estimating student postsecondary success at the school or district level. The tool guides education agency researchers, analysts, and decisionmakers through options to consider when developing their own model. The resulting model generates an…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly com- mon in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

Background: Data on children's ability to answer assessment questions correctly paints an incomplete portrait of what they know and can do mathematically; yet, it remains a common basis for program evaluation. Indeed, pre-post-assessment correctness is necessary but insufficient evidence for making inferences about learning and program…

With increased pressure for schools to demonstrate college and career readiness, it is crucial to explore the roles and activities of school counselors, the preservice training they receive, and how those college and career readiness concepts are integrated into their roles. The research questions were (1) What are the current roles and activities…

This position paper examines the phenomenon of the McNamara Fallacy to analyse flawed conceptions of "success" in mathematics learning, normalised assessment structures and their implications for mathematics education. The established presence of the McNamara Fallacy and the ramifications of this statistical fallacy provide a foundation…

School psychology has heavily relied on quantitative methodology to create and sustain our knowledge of best practices regarding academic, behavioral, and mental health outcomes for students. Nevertheless, underlying assumptions of the neutrality of quantitative data have obfuscated how school psychology research has perpetuated oppressive…

In recent years, the system of student learning and academic emotions has been taken seriously to re-engineer the teaching-learning process at all levels of education. This research paper considers both aspects of assessing the translation of knowledge i.e. qualitative and quantitative. In the current scenario, quantitative and qualitative…

The purpose of this research is to identify the situation through content analysis of scale development studies conducted by Turkish researchers in the field of preschool education. Thus, the overall trend of scale development research in preschool education was established. This research is a document analysis study. The documents studied are…