This study was undertaken to test the hypothesis that items of the Test of English as a Foreign Language (TOEFL) containing reference to American people, places, customs, etc., tend to favor examinees who have spent some time living in the United States. Two samples of examinees were drawn from the March 1987 TOEFL administration, one tested in…

Most seasoned test developers recognize the importance of thoughtful decision making when constructing a test. Unfortunately, many classroom achievement tests are created by novice test developed who have not received sufficient instruction in item writing (G. Gulliksen, 1986; R. J. Stiggins, 1991). The result is often a test that is poorly…

The reasoning skills tapped by the analytical measure of the Graduate Record Examinations were studied by examining how performance on its constituent type items relate to alternative criteria. Another objective was to ascertain the extent to which additional information on examinees' analytical skills might be obtained from further analyses of…

This study examined the relation of performance on the Test of English as a Foreign Language (TOEFL) to a widely used variant of the cloze procedure, the multiple choice (MC) cloze method. Examinees taking an operational TOEFL (n=11,290) were given three basic sections of the test along with a section containing prepared MC cloze items, and…

The design, administration, scoring, and results of the 1993 New York State Correctional Captain Examination are described. The examination was administered to 405 candidates. As in previous Sergeant and Lieutenant examinations, candidates also completed latent image written simulation problems and open/closed book multiple choice test components.…

Computerized adaptive (CA) testing uses an algorithm to match examinee ability to item difficulty, while self-adapted (SA) testing allows the examinee to choose the difficulty of his or her items. Research comparing SA and CA testing has shown that examinees experience lower anxiety and improved performance with SA testing. All previous research…

The hypothesis that faulty classical psychometric and sampling procedures in test construction could generate systematic bias against ethnic groups with smaller representation in the test construction sample was studied empirically. Two test construction models were developed: one with differential representation of ethnic groups (White, African…

This study analyzed English language tests administered in Brazil as part of a university entrance examination, focusing on the authenticity of its tests of second language reading comprehension, the concept of reading as an interactive process between reader and text, a proficiency-based view of language instruction, and the psychometric…

This handbook has been written for college teachers regardless of their prior training in pedagogy, assessment, or education. It is a practical handbook, designed for easy reference. Part 1 can provide either an introduction to Classroom Assessment or a comprehensive review, depending on the reader's prior experience. The first chapter explains…

While computer-based tests might be as simple as computerized versions of paper-and-pencil examinations, more innovative applications also exist. Examples of innovations in computer-based assessment include the use of graphics or sound, some measure of interactivity, a change in the means in which examinees responded to items, and the application…

This guide is designed to help teachers create test items that measure a variety of higher level thinking abilities. Part One, "Foundations for Item Writing," provides a context for item writing. Chapter 1 provides an overview of the book and defines basic concepts, principles, and terminology. Chapter 2 integrates research literature to…

This study investigates the amount of uncertainty added to National Assessment of Educational Progress (NAEP) estimates by equating error under both ideal and less than ideal circumstances. Data from past administrations are used to guide simulations of various equating designs and error due to equating is estimated empirically. The design…

Current practice in language testing has not yet integrated classical test theory with assessment of language skills. In addition, language testing needs to be part of theory development. Lack of sound testing procedures can lead to problems in research design and ultimately, inappropriate theory development. The debate over dimensionality of…

How data gathered through item response theory (IRT) analysis can be used to give immediate diagnostic information without a computer is explained. The Kidmap, developed by B. D. Wright and others (1980), provides clear information in a visual manner. Its major problem lies in the need for a computer and suitable software to construct a Kidmap.…

Tables of specifications are used to guide test developers in sampling items and maintaining consistency from form to form. This paper is a generalizability study of the American College Testing Program (ACT) Achievement Program Mathematics Test (AAP), with the content areas of the table of specifications representing multiple dependent variables.…