The purpose of this study was to explore the degree of grain size of the attributes and the sample sizes that can support accurate parameter recovery with the General Diagnostic Model (GDM) for a large-scale international assessment. In this resampling study, bootstrap samples were obtained from the 2003 Grade 8 TIMSS in Mathematics at varying…

Radical reform in science and mathematics education is needed to prepare citizens for challenges of the emerging knowledge-based global economy. We consider definite proposals to establish: (1) "Standards of science and math literacy" for all students. (2) "Integration of the science curriculum" with structure of matter,…

The purpose of this study is to present and illustrate the application of a general linear model for the analysis of test networks based on Rasch measurement models. Test networks can be used to vertically equate a set of tests which cover a wide range of difficulties. The criteria of coherence and consistency are proposed in order to assess the…

The purpose of this paper is to derive explicit estimates of the parameters of a latent structure model when the skills represented by the test items are hierarchically related. Two special cases are described, which may be used as an approximation to the Dayton and Macready model and also provide initial estimates in an iterative estimation…

A simplex model is presented for the analysis of longitudinal academic growth variables in which only one measure is obtained at each time. When this model fits the observed data, then reliabilities and unattenuated correlations can be estimated except for the first and last periods. (Author)

A method for detecting instructional sensitivity (item bias) in test items is proposed. This method extends item response theory by allowing for item-specific variation in measurement relations across students' varying instructional backgrounds. Item bias detection is a by-product. Traditional and new methods are compared. (SLD)

Research on the Rasch model of test and item analysis was applied to tests constructed from item banks for reading and mathematics with respect to five practical problems for scaling items and equating test forms. The questions were: (1) Does the Rasch model yield the same scale value regardless of the student sample? (2) How many students are…

The Rasch model is described as a latent trait model which meets the five criteria that characterize reasonable and objective measurements of an individual's ability independent of the test items used. The criteria are: (1) calibration of test items must be independent of particular norming groups; (2) measurement of individuals must be…

This study investigated the dimensionality of mathematics subscale scores from the National Assessment of Educational Progress for the assessment's Technical Review Panel, specifically for the data from the 1990 and 1992 main assessment in relation to students' instructional and noninstructional background variables. Discriminant analysis was…

The potential value of developing item banks that would both guarantee the quality of teacher-made examinations and allow for national comparison of student achievement is described. Use of Rasch model methods, rather than classical item analysis techniques, to calibrate the items for these banks is illustrated. (BS)

The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

This book shows the advantages of Rasch measurement (G. Rasch) for school district testing programs. The results of Rasch methods are contrasted with conventional statistics for assessing student responses to basic skills testing. Chapter 1 shows how the Rasch probability-based method produces measures that are more useful for students, parents,…

For many years personalization of achievement testing has been impossible in all but the simplest forms. Recently, item response theory (IRT), or latent trait theory, has emerged as a valuable tool which brings far greater flexibility to the process than had previously been possible. The single parameter Rasch Model, a mathematical model developed…

Item response data were obtained from large samples of students in Grades K-community college, taking the following tests: Stanford Early School Achievement Test, Stanford Achievement Test, Stanford Test of Academic Skills, Stanford Diagnostic Reading Test, and Stanford Diagnostic Mathematical Test. Data were classified as fitting or non-fitting…

State testing programs often attempt to provide annual information for use in student guidance and qualification, school and program evaluation, and broad policy decisions. With the development of a new type of assessment instrument, the "duplex design," the several functions of state testing programs can be served in a single test…