A differential item functioning (DIF) simulation study was conducted to explore the type and level of impact that contamination had on type I error and power rates in DIF analyses when the suspect item favored the same or opposite group as the DIF items in the matching subtest. Type I error and power rates were displayed separately for the…

A computer adaptive test (CAT) is a delivery methodology that serves the larger goals of the assessment system in which it is embedded. A thorough analysis of the assessment system for which a CAT is being designed is critical to ensure that the delivery platform is appropriate and addresses all relevant complexities. As such, a CAT engine must be…

Computerized adaptive testing is subject to security problems, as the item bank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees' trait level. The most common way of reducing this risk is to impose a…

Cross-validation in relation to choosing the best tests and selecting the best items in tests is discussed. Cross-validation demonstrated whether a decision derived from one set of data is truly effective when this decision is applied to another independent, but relevant, sample of people. Cross-validation is particularly important after…

To compare the means, reliability coefficients, and concurrent validity coefficients for four tests, two with and two without optional items; and to determine if pupils could select items that would improve their scores, 210 seventh grade pupils were first administered the seventh grade spelling subtest of the Iowa Tests of Basic Skills. They were…

To help teachers who must produce test items to measure instructional objectives, 54 teacher education candidates participated in an experiment where easily understood constraints on item production were manipulated. Four forms of a test item writing exercise sheet were randomly distributed, each asking for the production of eight sample test…

Ten item discrimination indices, across a variety of item analysis situations, were compared, based on the validities of tests constructed by using each of the indices to select 40 items from a 100-item pool. Item score data were generated by a computer program and included a simulation of guessing. (Author/CTM)

THE FEASIBILITY OF USING AN ITEM-ANALYSIS APPROACH FOR THE EVALUATION OF AN INNOVATIVE NINTH-GRADE CURRICULUM WAS EXPLORED. A POOL OF TEST ITEMS WAS DEVELOPED, FOR EACH OF THE THREE UNITS TO BE EVALUATED, BY EXAMINING ENGLISH TEXTBOOKS AND TEACHER'S GUIDES, AND BY WRITING ITEMS THAT REPRESENTED THE MAJOR OUTCOMES EXPECTED OF EACH OF THE…

The suggestion that multiple-choice items can be converted to true-false items without essentially changing what the item measures and with possible improvement in efficiency is investigated. Each of the 90 four-choice items in a natural science test was rewritten into a pair of true-false items, one true, one false. The resulting 180 items were…

Item-test correlations are compared to item test-retest correlations as measures for selecting items in test construction. The author concludes that the item test-retest method is superior for item analysis which aims at getting shorter tests while maintaining test stability. (Author/JKS)

It is suggested that funders revise the manner in which accountability is determined regarding both program superiority and the way in which special school programs are evaluated. In any alternative mode of showing accountability, preoccupation with dollars and amount learned should not take precedence over humaneness in the classroom. (Author)

As a preliminary step in customizing the Stanford Achievement Test, a study was made to compare the test items at each level with the curriculum objectives of a Florida school district, classifying them as either matching, above or below grade level, or unmatching. Results are shown in table form. (TE)

Error in assessing learning aptitude inheres much more in the users of the tests than in the tests themselves. Assumptions fundamental to such assessment are considered. It is particularly important that the tester constantly be sensitive to the nature of the relaionship between the psychological demands of test items or tests and the learning…

Analyses of student responses to Introductory Psychology test questions were discussed. The publisher supplied a two thousand item test bank on computer tape. Instructors selected questions for fifteen item tests. The test questions were labeled by the publisher as factual or conceptual. The semester course used a mastery learning format in which…