Background: The generalizability of a study refers to the extent to which the results and inferences from a sample apply to individuals in a larger target population of inference (Shadish et al., 2002). In practice, the strongest tool to facilitate generalizations is random or probability sampling, which is rare in educational studies (Olsen et…

Background: Multisite designs, also known as blocked designs, are experimental designs in which the random assignment of treatment and control conditions is within each site (or block) after the random selection of sites (or blocks). Multisite designs exhibit remarkable adaptability and, statistically, it can maintain a rigorous basis for…

Parallel analysis has been considered one of the most accurate methods for determining the number of factors in factor analysis. One major advantage of parallel analysis over traditional factor retention methods (e.g., Kaiser's rule) is that it addresses the sampling variability of eigenvalues obtained from the identity matrix, representing the…

Prior research has suggested that clustered regression discontinuity designs are a formidable alternative to cluster randomized designs because they provide targeted treatment assignment while maintaining a high-quality basis for inferences on local treatment effects. However, methods for the design and analysis of clustered regression…

This technical report provides detailed information about the sample, survey instruments, and resultant data for the Fall 2024 Pre-Kindergarten Teacher Survey (PKTS) which was administered via RAND's American Teacher Panel (ATP). The ATP is a nationally representative sample of public school teachers and part of the broader American Educator…

When performing an aggregate data meta-analysis of a continuous outcome, researchers often come across primary studies that report the sample median of the outcome. However, standard meta-analytic methods typically cannot be directly applied in this setting. In recent years, there has been substantial development in statistical methods to…

While testlets have proven useful for assessing complex skills, the stem shared by multiple items often induces correlations between responses, leading to violations of local independence (LI), which can result in biased parameter and ability estimates. Diagnostic procedures for detecting testlet effects typically involve model comparisons testing…

Quantitative evidence synthesis methods aim to combine data from multiple medical trials to infer relative effects of different interventions. A challenge arises when trials report continuous outcomes on different measurement scales. To include all evidence in one coherent analysis, we require methods to "map" the outcomes onto a single…

Education policy research aimed at eliminating racism necessitates methodological innovation that fosters both equity-centered approaches and robust empirical analysis of the systemic nature of racism. Most quantitative research in educational psychology omits the racist environment that students in K-12 education exist in (DeCuir-Gunby &…

Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distribution that is usually assumed. Recent work has shown that the difference in sampling model can have profound negative effects on statistics usually used to…

Physics education researchers are interested in using the tools of machine learning and natural language processing to make quantitative claims from natural language and text data, such as open-ended responses to survey questions. The aspiration is that this form of machine coding may be more efficient and consistent than human coding, allowing…

Accelerated longitudinal designs (ALDs) provide an opportunity to capture long developmental periods in a shorter time framework using a relatively small number of assessments. Prior literature has investigated whether univariate developmental processes can be characterized with data obtained from ALDs. However, many important questions in…

In today's data-driven and data-informed educational landscape, leaders face increasing pressure to make decisions and present results based on what appear to be comprehensive statistical analyses. However, the ethical implications of these responsibilities can be complex, particularly when statistical results carry the potential to be…

This Technical Annex report sets out methodological and technical notes for the 2024 Technical Education Learner Survey. It accompanies two substantive reports -- 'Technical Education Learner Survey 2024: progression of the 2nd T Level cohort' and 'Technical Education Learner Survey 2024: progression of Level 4/5 learners'. The main body of the…

The purpose of this research is to identify the situation through content analysis of scale development studies conducted by Turkish researchers in the field of preschool education. Thus, the overall trend of scale development research in preschool education was established. This research is a document analysis study. The documents studied are…