Multiple-choice reading comprehension items from a conventional, norm-referenced reading comprehension test were successfully analyzed using a simple latent class model. Results support the use of latent class, state mastery models with more heterogenous item pools than has been previously advocated. (Author/PN)

Tests seven- , 10- , and 13-year-olds for developmental differences in processes and strategies involved in geometric matrix solution and the relationship between strategy differences and item complexity. (AS)

This study examined the impact of rater agreement on decisions concerning the alignment between the Golden State Examination (GSE) in High School Mathematics and the University of California (UC) "Statement on Competencies in Mathematics." UC faculty and high school mathematics teachers (n = 20) rated the mathematics items of the GSE…

The purpose of this document is to familiarize educators and parents with the text-based portion of the Delaware Student Testing Program (DSTP) writing assessment for third grade. The DSTP writing assessment consists of one "stand-alone" writing prompt (representing 2/3 of the overall writing score) and one "text-based" prompt…

The purpose of this study was to compare and evaluate three online pretest item calibration/scaling methods in terms of item parameter recovery when the item responses to the pretest items in the pool would be sparse. The three methods considered were the marginal maximum likelihood estimate with one EM cycle (OEM) method, the marginal maximum…

The focus in this study was on science achievement measures and their relationships to three reasoning dimensions: basic knowledge and reasoning, spatial-mechanical reasoning, and quantitative science reasoning. Thirty multiple-choice items, 8 constructed response items, and 3 performance assessments, each nominally assigned to 1 of the reasoning…

In a previous study (1998), how to evaluate whether adaptive testing data used for online calibration sufficiently fit the item response model used by C. Glas was studied. Three approaches were suggested, based on a Lagrange multiplier (LM) statistic, a Wald statistic, and a cumulative sum (CUMSUM) statistic respectively. For all these methods,…

The main purpose of this study was to illustrate a polytomous IRT-based linking procedure that adjusts for rater variations. Test scores from two administrations of a statewide reading assessment were used. An anchor set of Year 1 students' constructed responses were rescored by Year 2 raters. To adjust for year-to-year rater variation in IRT…

A new standard setting approach is introduced, called the cognitive components approach. Like the Angoff method, the cognitive components method generates minimum pass levels (MPLs) for each item. In both approaches, the item MPLs are summed for each judge, then averaged across judges to yield the standard. In the cognitive components approach,…

The psychometric research done by G. Rasch between 1951 and 1959, which is explained and illustrated in this book, takes psychometrics from being purely descriptive to being a science of objective measurement. Individual centered statistics require models in which each individual is characterized separately and from which, given adequate data,…

This videotape contains a series of presentations by Benjamin D. Wright of the University of Chicago about the Rasch model and measurement in testing. The first presentation is excerpts from a workshop held in 1974 for educators from the Portland (Oregon) Public Schools and the Oregon Department of Education. Dr. Wright's lectures were part of a…

In 1998, the Kentucky General Assembly called for a new testing system known as the Commonwealth Accountability Testing System (CATS) to determine how much children are learning in school. This brochure tells the basics about Kentucky's system of public education. The "Core Content" document describes what students should know and be…

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA reading assessment. It contains samples and instructions for developing assessment items for grades 5, 8, and 11. Although designed for teachers, the Handbook is meant to be a…

This paper discusses recent developments in language testing. It begins with a review of the traditional criteria that are applied to all measurement and outlines recent emphases that derive from the expanding range of stakeholders. Drawing on Alderson's seminal work, criteria are presented for evaluating communicative language tests. Developments…

The Delaware Student Testing Program (DSTP) is designed to assess progress toward the Delaware Content Standards. Every year a certain number of items are removed from the test and then selected for public release. This booklet contains items released from the 1998 administration of the DSTP mathematics component tests. Taken as a whole, these…