This evaluation package contains two model tests, one for the Alberta (Canada) French 20 course (intermediate 4/5) and one for French 30 (intermediate 5/6). The tests were designed for holistic evaluation of high school students' language performance based on an experiential/communicative approach. They allow teachers to obtain a sampling of…

This document contains test items to measure the job skills of electromechanical technicians. Questions are organized in four sections that cover the following topics: (1) shop math; (2) electricity and electronics; (3) mechanics and machining; and (4) plumbing, heating, ventilation and air conditioning, and welding skills. Questions call for…

A study was conducted to evaluate the feasibility of using item response theory (IRT) equating to reduce test form overlap of the Graduate Record Examinations (GRE) Subject Test in Mathematics. Monte Carlo methods were employed to compare double-part equating with 20-item common item blocks to triple-part equating with 10-item common item blocks.…

The Mantel-Haenszel approach for investigating differential item functioning (DIF) was applied to U.S. history items that were administered as part of the National Assessment of Educational Progress (NAEP). DIF analyses were based on the responses of 7,743 students in grade 11. On some items, Blacks, Hispanics, and females performed more poorly…

An item analysis study was conducted for two multiple-choice tests of introductory psychology created from a publisher's test bank. A 47-item multiple-choice test was administered to 247 students, and 433 students took a different 42-item multiple-choice test. Participants were from a large northeastern suburban community college. The difficulty…

This booklet presents the Written Response part of the English 30 Grade 12 Diploma examination. After instructions for students, the booklet presents the first part of the examination in which students respond to Patricia Keeney's poem "Swimming Alone," which addresses the complexities of risk-taking. The booklet then presents the second…

The relationship between multiple-choice and constructed-response science tests was investigated using confirmatory factor analysis. The tests were given to 872 students in grades 9 through 12. Each test was divided into several parcels of items. The fit of a one-factor model (parcels of both tests loading on the same factor) was compared with the…

Study skills books sometimes give conflicting advice concerning whether or not students should change their initial responses to multiple-choice questions about which they are unsure. In contrast, answer-changing research consistently shows that the majority of answer changes are from wrong to right. Responses of 244 community college students to…

In his pioneer investigations of deductive logical reasoning competence, R. H. Ennis (R. H. Ennis and D. H. Paulus, 1965) used a multiple-choice format in which the premises are given, and it is asked whether the conclusion would then be true. In the adaptation of his work for use in Jamaica, the three possible answers were stated as…

The Spanish Skills Placement Test (SSPT) is the product of a need for a Spanish literacy placement instrument for use with literacy, adult basic education, and pre-General Educational Development program students. The need for the test was expressed by a variety of Illinois literacy organizations and agencies, particularly those in Chicago. The…

A study demonstrated the utility of item analyses to investigate which items function well or poorly in a second language reading recall protocol instrument. Data were drawn from a larger study of 56 learners of German as a second language at various proficiency levels. Pausal units of scored recall protocols were analyzed using both classical…

Because testing comprehension of long (5- to 10-page) second-language texts is more complex than testing shorter texts, an alternative form of second language reading comprehension test is needed. In a guided summary completion test, students are presented with a greatly shortened version of the text (e.g., one-paragraph summary), containing…

The purpose of this study was to compare two non-parametric procedures, the Mantel-Haenszel (MH) procedure and the simultaneous item bias (SIB) procedure, with respect to their Type I error rates and power, and to investigate the conditions under which asymptotic distributional properties of the SIB and MH were obtained. Data were simulated to…

This essay explores what is known and what remains to be learned about the information value of performance items when they are used in large scale assessment. Within the context of the National Assessment of Educational Progress (NAEP), there is substantial interest in answering these questions as issues of national assessment are considered for…

Matches between questions in the Kentucky Instructional Results Information System for 1995-96 (KIRIS96), the Comprehensive Tests of Basic Skills, Fourth Edition (CTBS4), and the California Achievement Tests, Fifth Edition (CAT5) and the Kentucky Academic Expectations as they are defined in the Kentucky curriculum framework were studied. Each…