This study has investigated the comparability of computer-based testing (CBT) writing prompts in the Test of English as a Foreign Language™ (TOEFL®) for examinees of different native language backgrounds. A total of 81 writing prompts introduced from July 1998 through August 2000 were examined using a three-step logistic regression procedure for…

Major analyses of the achievement tests used in the Beginning Teacher Evaluation Study were conducted to determine test reactivity to instruction. Reading and mathematics tests were administered to second and fifth grade children. Classroom teachers' records were examined to determine the amount of opportunity students had to learn the content…

The Fundamental Achievement Series (FAS) is designed to cover a range of ability from basic literacy to approximately the eighth grade. These tests are used in the employment or educational placement of adults and adolescents who have not been exposed to formal education, or the educationally disadvantaged. The FAS contains a Verbal and a…

The effects of test content reflecting black or white culture, on the performance of college-bound students of both races was examined. Eighty-five culture-specific items were developed for use in the English Usage and Social Studies Reading subtests of the ACT (American College Testing) Assessment Program. Items were administered as four separate…

The criterion-oriented problem of test bias and fairness in selection is compared to the construct-oriented problem of comparability of test scores in cross-cultural research. These problems are shown to have important similarities, and their studies may supplement each other. In a formulation of psychometric criteria for the comparability of test…

This symposium consists of five papers and presents some recent developments in adaptive testing which have applications to several military testing problems. The overview, by James R. McBride, defines adaptive testing and discusses some of its item selection and scoring strategies. Item response theory, or item characteristic curve theory, is…

All second and third graders in California public schools were administered the Reading Test of the California Assessment Program; performance of all sixth and twelfth graders in reading, written expression, spelling, and mathematics was assessed with the Survey of Basic Skills. Findings were compared to those of previous years and can be…

To determine if tryout samples typically used for item selection contribute to test bias against minority groups, item analyses were made of the California Achievement Tests using seven subgroups of the standardization sample: Northern White Suburban, Northern Black Urban, Southern White Suburban, Southern Black Rural, Southern White Rural,…

This textbook is intended for use in an introductory course in the use of tests in schools and colleges. The book is divided into five parts: (1) history and philosophy--educational measurement, historical perspectives; Measurement and the process of education; (2) classroom test development--what should achievement tests measure?; How should…

In 2004, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) conducted an assessment of a sample of Year 6 and Year 10 students across Australia to assess their proficiency in civics and citizenship. The assessment of civics and citizenship is part of a national plan that is being put progressively in place to…

Three approaches to the construction of achievement tests are compared: construct, operational, and empirical. The construct approach is based upon classical test theory and measures an abstract representation of the instructional objectives. The operational approach specifies instructional intent through instructional objectives, facet design,…

This case study recounts the attempts of two school districts to improve decision making on the adoption of a new elementary social studies curriculum by using formal evaluation methodology. The study's main objective was to develop a series of criterion referenced (mastery level) tests from a list of social studies objectives to determine whether…

This manual is intended to serve as a step-by-step guide to writing criterion-referenced tests. It includes directions on constructing and scoring various types of test items to measure each level of cognitive function. The manual gives a method for writing, analyzing and rewriting instructional objectives; preparing a content outline; matching…

The Milwaukee Bilingual Education Program has been guided by behavioral objectives related to desired pupil, staff, management, parent and community outcomes. The objectives were developed and revised mainly by curriculum supervisors. Frequent references are made to two publications, "Milwaukee Public Schools Bilingual Elementary Program…

The great growth in college enrollments, the changes in the availability of positions for college graduates, and the development in the science of testing go hand-in-hand in making the problem of the prediction of college success of greater importance than ever before. This bulletin brings the attention of educators upon the work which has been …