General chemistry tests from the Examinations Institute of the Division of Chemical Education of the American Chemical Society have been analyzed to identify factors that may influence how individual test items perform. In this paper, issues of item order (position within a set of items that comprise a test) and answer order (position of correct…

In the attempt to identify or prevent unfair tests, both quantitative analyses and logical evaluation are often used. For the most part, fairness evaluation is a pragmatic attempt at determining whether procedural or substantive due process has been accorded to either a group of test takers or an individual. In both the individual and comparative…

A computer program which computes both the interjudge reliability of individual measurements and the extent to which the judges are biased in their ratings vis-a-vis each other is presented. The methods proposed are recommended on the basis of recent developments in statistical research. (Author/JKS)

The 27 papers in this collection (26 of which were presented at the conference) are organized according to the eight topical sessions: (1) Improving Ability Measurement Using Different Item Formats, (2) Alternative Models for Adaptive Testing, (3) Psychological and Subgroup Effects, (4) Performance Testing by Interactive Simulation, (5)…

The effects of examiner unfamiliarity on the test performance of language handicapped and nonhandicapped preschoolers and school-age children are explored. Results indicate that examiner unfamiliarity selectively depresses handicapped children's test performance, constituting a systemic source of error and threatening the validity of handicapped…

A method for obtaining curriculum-based estimates of student achievement is described. These estimates can be obtained through the use of a set of curriculum weights designed to reflect student opportunity to learn. If the match between the presented curriculum and test content is low, then the curriculum weights can be used to minimize potential…

When an examination consists in whole or part of constructed response test items, it is common practice to allow the examinee to choose a subset of the constructed response questions from a larger pool. It is sometimes argued that, if choice were not allowed, the limitations on domain coverage forced by the small number of items might unfairly…

This article presents a meta-analysis of the effects of examiner familiarity/unfamiliarity on children's performance during individual testing. Data came from 22 controlled studies involving 1489 subjects. In a typical study, the effect of examiner familiarity raised test performance by .35 standard deviations. Differential performance favoring…

Based on data from 22 controlled studies, this article presents a meta-analysis of the effects of examiner familiarity on children's test performance. It was found that examiner familiarity raised scores especially when subjects were: (1) of low socioeconomic status; (2) tested on difficult tests; and (3) knew the examiner for a long duration.…

Describes and analyzes the social organization of testing as an interactional phenomenon. Provides examples of exchanges between clinician and child in a diagnostic testing situation. States these coorientational activities demonstrate that testing has an interactional basis. Explores the implications for research on bias in mental testing. (NL)

This publication reviews issues and processes in the quest for less-biased, least-biased, non-biased assessment. It is intended to aid the school psychologist in assisting all individuals in placement or program decisions for school-age children. The first section articulates the common sources of bias in assessment and identifies concepts…

This report lists various factors of psychological testing which might be more relevant and appropriate for elementary school age children in such areas as Appalachia. The areas covered are group individual testing, individual intelligence testing, achievement testing, special clinical testing, social maturity, and personality evaluation…

This article presents a quantitative synthesis of examiner familiarity effects on Caucasian and minority students' test performance. Fourteen controlled studies were coded in terms of methodological quality (high vs. low) and race-ethnicity (Caucasian vs. Black and Hispanic). An analogue to analysis of variance conducted on weighted unbiased…

Test publishers and the users of standardized IQ and summary-score achievement tests have failed to consider the problems associated with testing the minority child. Since the results of these tests are used to determine the education, economic, and social future of children, a harder look at the minority child's cultural background is essential.…

This article presents the background, the history, and the implications of the Larry P. v Riles decisions in 1972 and in 1979 in which a federal district court enjoined California from using any standardized intelligence tests to assess Black children for eligibility for classes of educable mentally retarded. (Author/CTM)