To compare the means, reliability coefficients, and concurrent validity coefficients for four tests, two with and two without optional items; and to determine if pupils could select items that would improve their scores, 210 seventh grade pupils were first administered the seventh grade spelling subtest of the Iowa Tests of Basic Skills. They were…

Ten item discrimination indices, across a variety of item analysis situations, were compared, based on the validities of tests constructed by using each of the indices to select 40 items from a 100-item pool. Item score data were generated by a computer program and included a simulation of guessing. (Author/CTM)

The suggestion that multiple-choice items can be converted to true-false items without essentially changing what the item measures and with possible improvement in efficiency is investigated. Each of the 90 four-choice items in a natural science test was rewritten into a pair of true-false items, one true, one false. The resulting 180 items were…

Item-test correlations are compared to item test-retest correlations as measures for selecting items in test construction. The author concludes that the item test-retest method is superior for item analysis which aims at getting shorter tests while maintaining test stability. (Author/JKS)

The advantages of using psychometric thoery to design short forms of intelligence tests are demonstrated by comparing such usage to a systematic random procedure that has previously been used. The Wechsler Intelligence Scale for Children Revised (WISC-R) Short Form is presented as an example. (JKS)

Teacher-selected test level resulted in: (1) most Educable Mentally Retarded students tested responding above chance levels on all subtests of the Metropolitan Achievement Test, (2) reliability coefficients comparable to those of the standardization sample, and (3) moderate to high positive point-biserial correlations for all subtest-level…

Since grade-appropriate levels of standardized achievement tests must frequently be used in Elementary and Secondary Education Act Title I evaluations, there may be large discrepancies between test difficulty and the achievement level of those being tested, with resultant inaccuracies in the scores. Procedures based on the Rasch scaling model were…

The authors argue that personnel who select standardized achievement tests have been led to believe that the major achievement test batteries differ very little in terms of the topics they test; but that the content covered by these major tests is different, and that such differences have consequences for instructional content. To test this…

Three methods of item selection were used to select sets of 38 items from a 50-item verbal analogies test and the resulting item sets were compared for internal consistency, standard errors of measurement, item difficulty, biserial item-test correlations, and relative efficiency. Three groups of 1,500 cases each were used for item selection. First…

A set of 65 evaluation questions was compiled from published instruments. A total of 200 undergraduate students rated both their best and worst teacher from the previous term. Each of the set of 65 items was rated twice for the best teacher and twice for the worst teacher, with order randomized. Factor analysis of ratings of the Best Teachers, the…

The materials presented were developed for use in a series of conferences on testing and instruction sponsored by the National Institute of Education, with the United States Office of Education, the UCLA Center for the Study of Evaluation, and a network of research and development agencies. They are intended for use by school practitioners and…

Standardized tests of writing ability have individual and shared limitations and deficiencies that should be acknowledged by test designers and users. Most institutions use the portions of standardized tests that test ability to proofread and edit, but they do not use the optional essay sections that actually require students to write. To assure…

The development of the Student Selection Battery for the Beginning Teacher Evaluation Study is described. This battery, which measures reading and mathematics achievement in second and fifth grade students, will be used to select target students for the study of teaching effectiveness. Methodological considerations included: the limited amount of…

The results are presented of the validation study of reading and mathematics criterion referenced tests, administered to South Carolina students in grades 3, 6, and 8. This testing was mandated by state law to field test a competency based assessment program. The study was based on three activities: (1) test selection; (2) content validation; and…

The Beginning Teacher Evaluation Study (BTES), Phase II, was a research project on effective teaching behavior--what teachers do that significantly affects what and how pupils learn. The purposes of Phase II were to (1) develop an assessment system for measuring teacher and student behaviors and other factors which could influence each of them and…