In this study, differential item functioning (DIF) methods utilizing 14 different matching variables were applied to assess DIF in the constructed-response (CR) items from 6 forms of 3 mixed-format tests. Results suggested that the methods might produce distinct patterns of DIF results for different tests and testing programs, in that the DIF…

The most critical feature of a common-item nonequivalent groups equating design is that the average score difference between the new and old groups can be accurately decomposed into a group ability difference and a form difficulty difference. Two widely used observed-score linear equating methods, the Tucker and the Levine observed-score methods,…

Three methods of estimating point-biserial correlation coefficient standard errors were compared: (1) assuming normality; (2) not assuming normality; and (3) bootstrapping. Although errors estimated assuming normality were biased, such estimates were less variable and easier to compute, suggesting that this might be the method of choice in some…

This volume contains descriptions and statistical properties of test scales used with grade 10 through grade 12 students in the National Longitudinal Study of Mathematical Abilities (NLSMA). Each scale is designed to measure a specified content or psychological area chosen as a dependent variable for the study. The scales are briefly identified…

This volume contains descriptions and statistical properties of test scales used with grade seven through grade eight students in the National Longitudinal Study of Mathematical Abilities (NLSMA). Each scale is designed to measure a specified content or psychological area chosen as a dependent variable for the study. The scales are briefly…

The effects of item position on item statistics were studied in a large set of data from tests of word knowledge (WK) and arithmetic reasoning (AR). Position effects on item response theory (IRT) parameter estimates and classical item statistics were also investigated. Data were collected as part of a project to refine the Army's Computerized…

Problems of scale typically arise when comparing test score trends, gaps, and gap trends across different tests. To overcome some of these difficulties, we can express the difference between the observed test performance of two groups with graphs or statistics that are metric-free (i.e., invariant under positive monotonic transformations of the…

This study was designed to illustrate the use of the Rasch model procedure to equate the Dade County Compensatory Education Skills Test (DCCEST) to the State Student Assessment Test (SSAT) for both mathematics skills and communications skills. The SSAT was a test developed by the Florida State Department of Education to measure students' level of…

A comparison of the results of grades 4, 7, and 10 of the Dearborn Public Schools and the state attainment on the Michigan Educational Assessment Program (MEAP) by skill areas and objectives is described. The contents include (1) Dearborn versus state MEAP attainment results, (2) comparison of MEAP results with previous MEAP results of same groups…

Results of new research into the anomalous results of the 1986 reading portion of the National Assessment of Educational Progress (NAEP) are reported. The original analysis of the 1986 data indicated that the estimated performance level of 9- and 17-year-old students had dropped dramatically since 1984, whereas the performance of 13-year-olds had…

Latent trait model calibration procedures were used on data obtained from a group testing program. The one-parameter model of Wright and Panchapakesan and the three-parameter logistic model of Wingersky, Wood, and Lord were selected for comparison. These models and their corresponding estimation procedures were compared, using actual and simulated…

TAILOR is a computer program that uses the implied orders concept as the basis for computerized adaptive testing. The basic characteristics of TAILOR, which does not involve pretesting, are reviewed here and two studies of it are reported. One is a Monte Carlo simulation based on the four-parameter Birnbaum model and the other uses a matrix of…

This paper presents the dual approach to item bias detection employed in the Maryland Functional Testing Program (MFTP). Using instructional objectives mandated by the Maryland State Board of Education, the MFTP develops two levels of the Maryland Functional Reading Test (MFRT) and the Maryland Functional Mathematics Tests (MFMT). These…