This research investigated the use of the Rasch simple logistic model in item and test calibration. Tests employing word, picture, symbol, and number analogies were administered to college students, high school students, civil service clerical employees, and clients of the Minnesota Division of Vocational Rehabilitation. The results suggest that…

This paper highlights some special characteristics of criterion-referenced tests while comparing them with norm-referenced tests. Psychometric considerations involved in constructing a criterion-referenced test, including item analysis, reliability, and validity, are discussed, along with application of criterion-referenced testing to individual…

Outlines a method to write multiple (four) versions of each examination. Reviews some advantages and disadvantages of multiple-choice and open-ended problems. Considers the writing and grading techniques used. Reports that the examination met the consistency requirement and received a good evaluation from students. (YP)

Explored relationships between 137 grade-8 cognitive items used in the 1990 National Assessment of Educational Progress and selected themes from the National Council of Teachers of Mathematics'"Standards." About half the items related to four "Standards" themes, with most of those being related to problem solving and reasoning.…

Tests of spatial ability were analyzed for their analog (visuospatial) and nonanalog (verbal reasoning) components, using factor analyses of items and test scores. The self-selected sample consisted of over 2000 clients (average age about 26 or 27) employing the Johnson O'Connor Research Foundation's aptitude evaluation services in 12 metropolitan…

The validity and reliability of the Yugoslavian (Beograd) version of the Hungarian adaptation of the Torrance Divergent Capacities Test (HAT-DAT) were tested, with a view toward improving the methodology of scoring the creative abilities test and determining standards for Yugoslavia. The test, based on the work of J. P. Guilford (1977), examines…

The stability of Rasch test item difficulty parameters was investigated under varying conditions. Data were taken from a mathematics achievement test administered to over 2,000 Australian students. The experiments included: (1) relative stability of the Rasch, traditional, and z-item difficulty parameters using different sample sizes and designs;…

Three questions concerning the Binary Search Method (BSM) of computerized adaptive testing were studied: (1) whether it provided a reliable and valid estimation of examinee ability; (2) its effect on examinee attitudes toward computerized adaptive testing and conventional paper-and-pencil testing; and (3) the relationship between item response…

Six new forms of Armed Services Vocational Aptitude Battery (ASVAB) were developed. These new forms were equated to a standard reference test, ASVAB 8a, using normative data based on a 1980 weighted probability sample of American youth, ages 18-23. Equating allows the services to report the distributions of examinee ability on a common metric or…

A project was conducted to develop vocational education tests for use in Georgia secondary schools, specifically for welding, machine shop, and sheet metal courses. The project team developed an outline of an assessment model that included the following components: (1) select a program for use in developing test items; (2) verify duties, tasks,…

The admissable probability measurement (APM) format was used to score a criterion referenced language arts test administered in an inner city junior high school. Its 30 items covered capitalization, punctuation, parts of speech, and sentence analysis. With APM, students indicate their confidence in their answer choice, and guessing is heavily…

This research, conducted for California State Department of Education, is one component of a feasibility study focusing on ways to make the testing process more efficient by application of multi-purpose tests (MPT). MPT are designed, administered and scored to serve more than one purpose and to consolidate and unify testing programs as a partial…

Birnbaum's three-parameter logistic item response model was used to study guessing behavior of low ability examinees on the Graduate Record Examinations (GRE) General Test, Verbal Measure. GRE scoring procedures had recently changed, from a scoring formula which corrected for guessing, to number-right scoring. The three-parameter theory was used…

Focusing on the use of the Metropolitan Achievement Test (MAT) with Project Follow Through evaluations, this report represents an extended discussion of the appropriateness of standardized tests for evaluation and policy research. First, the development of the MAT and its roots in the Army Alpha intelligence test are described in detail. The next…

To improve the accuracy of college placement, Rasch scoring and person-fit statistics on the Comparative Guidance and Placement test (CGP) was compared to the traditional right-only scoring. Correlations were calculated between English and mathematics course grades and scores of 1,448 entering freshmen on the reading, writing, and mathematics…