Evaluating blocked randomized experiments from a potential outcomes perspective has two primary branches of work. The first focuses on larger blocks, with multiple treatment and control units in each block. The second focuses on matched pairs, with a single treatment and control unit in each block. These literatures not only provide different…

The complexity in understanding the [epsilon-delta] definition has motivated research into the teaching and learning of the topic. In this paper I share my design of an instructional analogy called the Pancake Story and four different questions to explore the logical relationship between [epsilon] and [delta] that structures the definition. I…

Analysis of CCAPS-34 scores on a large (n = 4,852) university counseling center student sample supported internal consistency ([alpha] = 0.803-0.896), one-month test-retest reliability (r[subscript tt] = 0.706-0.829), convergent and divergent validity, and good model fit. Measurement invariance of scores for all categories of race and student…

The purpose of this study was to examine the psychometric properties of the goal orientation (GO) scale across job search contexts to facilitate its use in large and varied search settings. A sample of 720 job losers and new entrants' job seekers in Ghana completed the survey. Confirmatory factor analysis supported the three-factor theoretical…

In real-world situations, multidimensional data may appear on large-scale tests or attitudinal surveys. A simple structure, multidimensional model may be used to evaluate the items, ignoring the cross-loading of some items on the secondary dimension. The purpose of this study was to investigate the influence of structure complexity magnitude of…

Among current state-of-art estimation methods for multilevel IRT models, the two-stage divide-and-conquer strategy has practical advantages, such as clearer definition of factors, convenience for secondary data analysis, convenience for model calibration and fit evaluation, and avoidance of improper solutions. However, various studies have shown…

The Every Student Succeeds Act of 2015 requires states to use a variety of indicators, including standardized tests and attendance records, to designate schools for support and improvement based on schoolwide performance and the performance of groups of students within schools. Schoolwide and group-level performance indicators are also…

The piecewise latent growth models (PWLGMs) can be used to study changes in the growth trajectory of an outcome due to an event or condition, such as exposure to an intervention. When there are multiple outcomes of interest, a researcher may choose to fit a series of PWLGMs or a single parallel-process PWLGM. A comparison of these models is…

The growing number of children in primary schools in Germany who have German as their second language (L2) has raised questions about the fairness of performance assessment. Fair tests are a prerequisite for distinguishing between L2 learning delay and a specific learning disability. We evaluated five commonly used reading and spelling tests for…

This study evaluated the construct and structural equivalence of the English and Spanish versions of the authoritative school climate survey (ASCS). Measurement invariance was evaluated through increasingly restrictive tests on a sample of N = 6976 high school students, with focus on the three core ASCS scales: Students' Willingness to Seek Help,…

School climate is an essential ingredient of student well-being and academic success. Although it has been studied extensively, only a few well-validated instruments are available for the assessment of school climate. The aim of this study was to assess the factor validity and measurement invariance of the Socio-educational Environment…

The Schwarz or Bayesian information criterion (BIC) is one of the most widely used tools for model comparison in social science research. The BIC, however, is not suitable for evaluating models with order constraints on the parameters of interest. This article explores two extensions of the BIC for evaluating order-constrained models, one where a…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

Despite ongoing global efforts to combat discrimination, hate speech is a growing problem in many countries. Hate speech is also widespread among young people and thus also affects schools. Because of the negative consequences of hate speech for the targeted individuals and for society in general, schools and teachers are generally encouraged to…

This dissertation develops and applies sophisticated Item Response Theory (IRT) methods to address fundamental measurement challenges in cognitive testing, focusing on the Armed Services Vocational Aptitude Battery (ASVAB) data from the National Longitudinal Survey of Youth (NLSY). The first chapter implements a confirmatory multidimensional IRT…