In many psychological and educational applications, it is imperative to obtain valid and reliable score estimates of multilevel processes. For example, in order to assess the quality and characteristics of high impact learning processes, one must compute accurate scores representative of student- and classroom-level constructs. Currently, there…

Purpose: Research in communication sciences and disorders frequently involves the collection of clusters of observations, such as a series of scores for each individual receiving treatment over the course of an intervention study. However, little discipline-specific guidance is currently available on the subject of building and interpreting…

Using a sample of schools testing annually in grades 9-11 with a vertically linked series of assessments, a latent growth curve model is used to model test scores with student intercepts and slopes nested within school. Missed assessments can occur because of student mobility, student dropout, absenteeism, and other reasons. Missing data…

This dissertation is comprised of three papers that propose and apply psychometric models to deal with complexities and challenges in large-scale assessments, focusing on modeling rater effects and complex learning progressions. In particular, three papers investigate extensions and applications of multilevel and multidimensional item response…

This study illustrates why preschool children who are dual language learners (DLLs) are not a homogeneous group. An empirically developed model of preschool DLL subgroups, based on latent class analysis, was presented. The model reflects three separate subgroups of DLL children present in many classrooms where DLL children are served: Bilinguals,…

Background: The reciprocal I/E model (RI/EM) combines the internal/external frame of reference model (I/EM) with the reciprocal effects model (REM). The RI/EM extends the I/EM longitudinally and the REM across domains. The model predicts that, within domains, mathematics and verbal achievement (VACH) and academic self-concept have positive effects…

Using Hierarchical Linear Modelling (HLM), this study aimed to identify factors such as ESL/ELL/EAL status that would predict students' reading performance in an English language arts exam taken across Canada. Using data from the 2007 administration of the Pan-Canadian Assessment Program (PCAP) along with the accompanying surveys for students and…

The field of EDM has focused more on modeling student knowledge than on investigating what sequences of different activity types achieve good learning outcomes. In this paper we consider three activity types, targeting sense-making, induction and refinement, and fluency building. We investigate what mix of the three types might be most effective…

Value-added scores from tests of college learning indicate how score gains compare to those expected from students of similar entering academic ability. Unfortunately, the choice of value-added model can impact results, and this makes it difficult to determine which results to trust. The research presented here demonstrates how value-added models…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…

This study examines student growth on mathematics and reading assessments across academic years (Spring 2006 through Spring 2009) using three different growth models: hierarchical linear model (HLM), value-added model (VAM), and student growth percentile model (SGP). Comparisons across these three growth models were conducted to investigate the…

Educational experts have criticized status models of school accountability, as required by the No Child Left Behind Act (NCLB), describing them as ineffectual in measuring achievement because their one-time assessment of student knowledge ignores student growth. Research on student achievement has instead identified growth models as superior…

Value-added models have been widely used to assess the contributions of individual teachers and schools to students' academic growth based on longitudinal student achievement outcomes. There is concern, however, that ignoring the presence of missing values, which are common in longitudinal studies, can bias teachers' value-added scores.…

This exploratory study examined the associations between teacher-student relationship ratings and characteristics of students and teachers. A sample of fifth grade teachers (N = 115) and their students (N = 2070) were studied. Hierarchical linear modeling was employed to explore the associations between variables while taking both individual…

This paper investigates the differences in academic achievement trajectories from elementary through middle school among English Learner students in four different instructional programs: English Immersion, Transitional Bilingual, Developmental Bilingual, and Dual Immersion programs. Comparing students with the same parental preferences but who…