Multilevel models (MLMs) are flexible in that they can be employed to obtain item and person parameters, test for differential item functioning (DIF) and capture both local item and person dependence. Papers on the MLM analysis of item response data have focused mostly on theoretical issues where applications have been add-ons to simulation…

One of the fundamental problems in language testing is the lack of adequate generalizability between what a test is measuring and what fulfills the learners' real world language use needs. It is important to recognize that no matter how precise a test measures a construct, if the way that a construct is defined and the way that test tasks are…

This study was designed with the overall goal of understanding how difficulties in reading comprehension are associated with early adolescents' performance in large-scale assessments in subject domains including science and civic-related social studies. The current study extended previous research by taking a cognition-centered approach based on…

This study examined the "Tejas LEE or El Inventario de Lectura en Espanol de Tejas" (Grade 1) to determine if a relationship existed between reading comprehension in Spanish and the tested skills on the diagnostic assessment. This quantitative research design evaluated the psychometric characteristics of the Tejas LEE and followed customary…

In this technical report, we present the results of a reliability study of the third-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this technical report, we present the results of a reliability study of the fifth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this technical report, we present the results of a reliability study of the fourth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this technical report, we present the results of a reliability study of the sixth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

In this study, the effectiveness of detection of differential item functioning (DIF) and testlet DIF using SIBTEST and Poly-SIBTEST were examined in tests composed of testlets. An example using data from a reading comprehension test showed that results from SIBTEST and Poly-SIBTEST were not completely consistent in the detection of DIF and testlet…

The McKinney-Vento Homeless Education Assistance Improvements Act of 2001 (MCKV), which provides funds to local educational agencies (LEAs), is almost a decade old, yet no evaluations of its academic effectiveness have been reported. Using a systems theory framework, the authors answer the question of whether homeless students in grade 6 from LEAs…

This study examined the results of a uniquely constructed literacy assessment technique, combining Dehn's (2006) interpretation of psychological processing assessment and the Reading Rockets (Greater Washington Educational Telecommunications Association, Inc., 2005) interpretation of academic achievement. The study employed a quantitative…

School districts looking for ways to minimize summer learning loss have implemented a variety of programs to combat this problem. Since No Child Left Behind and the need for school districts to meet the goals of Adequate Yearly Progress, it is no longer enough to limit summer learning loss. Now school leaders find it necessary to use the summer…

An educational assessment embodies an argument from a handful of observations of what students say, do or make in a handful of particular circumstances, to what they know or can do in what kinds of situations more broadly. This article discusses ways in which research into the nature and development of expertise can help assessment designers…

A Markov chain Monte Carlo (MCMC) method and a bootstrap method were compared in the estimation of standard errors of item response theory (IRT) true score equating. Three test form relationships were examined: parallel, tau-equivalent, and congeneric. Data were simulated based on Reading Comprehension and Vocabulary tests of the Iowa Tests of…

Research suggests that development of the alphabetic principle is a critical factor in learning to recognize words and becoming a successful reader. The alphabetic principle encompasses both the understanding that relationships exist between letters and sounds and the application of these relationships to reading words. This study investigated the…