In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…

In item response theory (IRT), preequating depends upon item parameter estimate invariance. Three separate simulations, all using the unidimensional three-parameter logistic item response model, were conducted to study the impact of the following variables on preequating: (1) mean differences in ability; (2) multidimensionality in the data; and…

Designed to give guidance to those involved in the curriculum development process within the Shipyard Training Modernization Program (STMP), this guide provides an understanding of the fundamental practices followed in the curriculum development process. It also demonstrates incorrect and correct approaches to the development of the curriculum…

The purpose of this study was to determine whether item difficulty is significantly affected by language difficulty and response set convergence. Language difficulty was varied by increasing sentence (stem) length, increasing syntactic complexity, and substituting uncommon words for more familiar terms in the item stem. Item wording ranged from…

The Ohio Vocational Achievement Tests are specially designed instruments for use by teachers, supervisors, and administrators to evaluate and diagnose vocational achievement for improving instruction in secondary vocational programs at the 11th and 12th grade levels. This guide explains the Ohio Vocational Achievement Tests and how they are used.…

A type of item used frequently in standardized testing involves the recognition of a sentence. Examples of such items are the sentence completion items, used in both the Scholastic Aptitude Test (SAT) and the Graduate Record Examination (GRE), and the sentence correction items used in the Test of Standard Written English. Tests that contain such…

Open-ended individually administered questions can ascertain whether students can reason about arithmetic problems. Free response test items are useful in assessing students' thought processes as they solve mathematics story problems. Since story problems do not state explicitly which arithmetic operations are required for solution, students must…

Order Analysis is a multidimensional scaling (MDS) technique for determining order among items. This paper reviews articles by different authors describing various components of ordering theory. A common nomenclature is constructed to link together the various ideas and is applied to a fairly simple set of data. Topics discussed include a more…

This report presents the rationale, development, and standardization of the Air Force Officer Qualifying Test (AFOQT) Form O. The test is used to select individuals for officer commissioning programs, and candidates for pilot and navigator training. Form O contains 380 items organized in 16 subtests. All items are administered in a single test…

The goal of test design is to devise an instrument that will provide a stable and accurate assessment of student ability in some area. One means of reaching this goal is through the use of latent trait models, which determine the relationship between the unobservable trait or ability and the observable test performance. Three common latent trait…

This test for third grade students in Alberta, Canada, consists of two sections. Section I is divided into two parts: Part A has 25 questions covering numeration, geometry, and graphing, and part B has 25 questions covering operations and properties, measurement, and problem-solving strategies. Section II consists of four basic-fact tests in…

The effects of a multidimensional latent trait space on estimation of item and person parameters by the computer program LOGIST are examined. Several item pools were simulated that ranged from truly unidimensional to an inconsequential general latent trait. Item pools with intermediate levels of prepotency of the general latent trait were also…

Latent trait models are presented that can be used for test design in the context of a theory about the variables that underlie task performance. Examples of methods for decomposing and testing hypotheses about the theoretical variables in task performance are given. The methods can be used to determine the processing components that are involved…

This is the final test for students in the twelfth grade course Mathematics 30, offered in schools in Alberta, Canada. Intended for administration in 1988, it is available in both English and French. It contains 52 multiple-choice questions and 3 written-response problems, with 2.5 hours allowed for completion. Approved calculators may be used.…

The development and validation of a Portuguese oral language test are described. The test consisted of five item types: personal conversation, giving directions, description of picture sequences, topical discourse, and oral task completion based on printed instructions. Three preliminary forms of the test were administered to a group of language…