Described are procedures followed in developing, administering, and scoring a set of mathematical problem-solving superitems and examining their construct validity through a recently developed evaluation technique associated with a taxonomy of the structure of learned outcomes. Data strongly support the validity of the underlying theoretical…

The binomial error model includes form-to-form difficulty differences as error variance and leads to Ruder-Richardson formula 21 as an estimate of reliability. If the form-to-form component is removed from the estimate of error variance, the binomial model leads to KR 20 as the reliability estimate. (Author/BW)

While studying testing programs in juvenile incarceratory facilities, the authors found that there may be racial bias in the tests, test items, and in the interpretation of the tests. This article presents new data that have emerged from their original study. The focus is on performance on standardized norm-referenced tests. (CT)

Compares scores of 3,443 third graders in 1956 and 4,378 third graders in 1977 on the California Short Form Test of Mental Maturity. Examines differences in factoral structure and differences in ability level between groups for factors (64 items related to 7 components) apparently measuring consistent abilities. (SB)

The uses, advantages and disadvantages, preparation, and scoring of essay tests and oral tests are outlined and discussed, and sample questions of each type oriented to pharmaceutical instruction are provided. (MSE)

The multidimensional structure of verbal comprehension test items was investigated. Empirical evidence was provided to support the theory that item tasks are multivariate-multiordered composites of faceted components: language, contextual knowledge, and cognitive operation. Linear and circular properties of cylindrical manifestation were…

The purpose of this study is to explore the relationship between a set of item characteristics and the difficulty of TOEFL[R] dialogue items. Identifying characteristics that are related to item difficulty has the potential to improve the efficiency of the item-writing process The study employed 365 TOEFL dialogue items, which were coded on 49…

This study examines the effect of item response time across 30 items on ability estimates in a high stakes computer adaptive graduate admissions examination. Examinees were categorized according to 4 item response time patterns, and the categories are compared in terms of ability estimates. Significant differences between response time patterns…

Information provided for computerized adaptive test (CAT) simulees was compared under two conditions on two moderately correlated trait composites, mathematics and reading comprehension. The first condition used information provided by in-scale items alone, while the second condition used information provided by in- and out-of-scale items together…

Item writing is a major responsibility of trainers. Too often, qualified staff who prepare lessons carefully and teach conscientiously use inadequate tests that do not validly reflect the true level of trainee achievement. This monograph describes techniques for constructing multiple-choice items that measure student performance accurately. It…

This study describes the development and validation of an instrument to tap employee reflections on career interests, needs and career development opportunities. Item construction was based on issues identified in previous qualitative research and themes prevalent in recent HRD career development literature. Pilot data for an exploratory factor…

Context-dependent items are traditionally analyzed independently, creating a situation in which the potential local item dependence effects among these items may cause a biased estimation of examinees' abilities. This study investigated the local item dependence effects on testlets in the tryout version of a statewide science assessment by a Rasch…

This paper compares modified Guttman and item response theory (IRT) based procedures for classifying examinees in ordered levels when each level is represented by several multiple choice test items. In the modified Guttman procedure, within-level number correct scores are mapped to binary level mastery scores. Examinees are then assigned to levels…

The National Assessment of Educational Progress (NAEP) collects data in the form of repeated, discrete measures (test items) with hierarchical structure for both measures and subjects, that is complex by any standard. This complexity has been managed through a "divide and conquer" approach of isolating and evaluating sources of…

This document is a supplement to the Test Content Description for the Georgia High School Test in Science. The sample items are representative of items on the actual Georgia High School Tests. The strands (major areas) being tested are: (1) World Studies (18% to 20% of the test); (2) United States History since 1865 (18% to 20% of the test); (3)…