The agreement between Mantel-Haenszel and Rasch procedures for identifying differential item functioning (DIF) on teacher certification tests was studied. Two specific research questions were addressed: (1) whether the Mantel-Haenszel and Rasch procedures identify the same items as functioning differently; and (2) how consistently each method…

The Edmonton Grade III Achievement: 1956-1977 study is a comparison of achievement in reading, arithmetic, and language involving all of the third grade students in a large school system. Six basic skills tests which were administered to all of the Edmonton third grade students in 1956 were reprinted and administered to all of the third grade…

Goodness of fit of raw test score data were compared, using two latent trait models: the Rasch model and the Birnbaum three-parameter logistic model. Data were taken from various achievement tests and the Scholastic Aptitude Test (Verbal). A minimum sample size of 1,000 was required, and the minimum test length was 40 items. Results indicated that…

More than a dozen statistical models have been developed for the purpose of cognitive diagnosis. These models are supposed to extract a much finer level of information from item responses than traditional unidimensional item response models. In this paper, a general diagnostic model (GDM) was used to analyze a set of simulated sparse data and real…

Written from the perspective of a relatively large urban school district and dealing primarily with high school-type programs, this handbook is designed for use by local school district practitioners of vocational education evaluation. Part I discusses the history, present status, and goals and objectives of vocational education. Included are…

Four simulated mathematical and verbal test forms were produced by test assembly procedures proposed in legislative bills in California and New York in 1986 to minimize differences between majority and minority scores. Item response theory analyses of data for about 22,000 black and 28,000 White high-school students were conducted. (SLD)

This study has investigated the comparability of computer-based testing (CBT) writing prompts in the Test of English as a Foreign Language™ (TOEFL®) for examinees of different native language backgrounds. A total of 81 writing prompts introduced from July 1998 through August 2000 were examined using a three-step logistic regression procedure for…

Three approaches to the construction of achievement tests are compared: construct, operational, and empirical. The construct approach is based upon classical test theory and measures an abstract representation of the instructional objectives. The operational approach specifies instructional intent through instructional objectives, facet design,…

The Milwaukee Bilingual Education Program has been guided by behavioral objectives related to desired pupil, staff, management, parent and community outcomes. The objectives were developed and revised mainly by curriculum supervisors. Frequent references are made to two publications, "Milwaukee Public Schools Bilingual Elementary Program…

This report summarizes results of the Spring 2007 Austin Independent School District high school students' exit survey, with comparative results from previous years.

In 2004, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) conducted an assessment of a sample of Year 6 and Year 10 students across Australia to assess their proficiency in civics and citizenship. The assessment of civics and citizenship is part of a national plan that is being put progressively in place to…

Papers from the conference on language testing include: "Foundations and Directions for a New Decade of Language Testing" (Carol Chapelle, Dan Douglas); "A Comparison of the Abilities Measured by the Cambridge and Educational Testing Service EFL Test Batteries" (Lyle F. Bachman, Fred Davidson, John Foulkes); "Judgments in…

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…