Standard and experimental forms of the Johnson O'Connor Research Foundations Analytical Reasoning test were administered to 1,496 clients of the Foundation (persons seeking information about aptitude for educational and career decisions). The objectives were to develop a new form of the test and to better understand what makes some items more…

In preparation for a study of essay questions and other forms of open-ended exercises in the California Golden State Examination for biology, the functioning of open-ended biology items in another examination was explored. The Golden State Examination program offers honors credit to students who wish to qualify for admission to programs in…

Direct assessments of the accuracy with which raters can use a rating instrument are presented. This study demonstrated how surplus behavioral incidents scaled during the development of Behaviorally Anchored Rating Scales (BARS) can be used effectively in the evaluation of the newly developed scales. Construction of scenarios of hypothetical…

"Item models" (LaDuca, Staples, Templeton, & Holzman, 1986) are classes from which it is possible to generate/produce items that are equivalent/isomorphic to other items from the same model (e.g., Bejar, 1996; Bejar, 2002). They have the potential to produce large number of high-quality items at reduced cost. This paper introduces…

The agreement between the Educational Testing Service (ETS) and the Golden Rule Insurance Company of Illinois is interpreted as setting the general principles on which items must be selected to be included in a licensure test. These principles put a limit to the difficulty level of any item, and they also limit the size of the difference in…

Methods proposed by L. A. Goodman (1987) for analyzing intrinsic properties of cross-classified nominal or ordered categorical variables were used to examine the performance of items measuring psychological adjustment (PA). These methods were applied to 35 3x4 tables cross-classifying 1,158 persons according to their mental health status (MHS) and…

A study examined the nature of functional literacy among 671 Moroccan children, aged 11-14, and the relationship of functional and classroom literacy to background factors and school experience. Students were assessed on a series of household literacy tasks sampling knowledge of spatial and monetary print conventions, specialized vocabulary, and…

A comparison of the results of grades 4, 7, and 10 of the Dearborn Public Schools and the state attainment on the Michigan Educational Assessment Program (MEAP) by skill areas and objectives is described. The contents include (1) Dearborn versus state MEAP attainment results, (2) comparison of MEAP results with previous MEAP results of same groups…

This report summarizes the results of research designed to study the psychometric and technological feasibility of adaptive testing to assess spatial ability. Data was collected from high school students on two types of spatial items: three-dimensional cubes and hidden figure items. The analysis of the three-dimensional cubes focused on the fit of…

This paper overviews technical developments in data analysis procedures for the National Assessment of Educational Progress (NAEP) reading data during 1984. The highlight of the reshaping of the NAEP data has been the scaling using item response theory (IRT). AT this point in the data analysis, an IRT-based scale appears appropriate for reading…

This module contains resource materials to help vocational education teachers construct effective written tests. (The materials supplement the videotape on "Written Test Construction.") Materials in the packet include guidelines for developing written tests in general and specific guidelines for the five major types of test items, brief…

This report describes the procedures used to construct and validate the Standardized Test of Computer Literacy (STCL), a criterion-referenced instrument designed to assess students' computer literacy. Following a statement of the study problem and purpose, a description of the study methodology outlines the use of a 12-step model for development…

Field tests of test items are useful in developing cutting scores for important tests, such as teacher certification examinations and high school graduation tests, because they indicate test item quality and estimate future examinee performance. However, field test data may provide a faulty indication of examinee performance on the real test.…

This document reports the findings of an evaluation of the Family Day Care Training and Accreditation Program, a voluntary program for family day care providers in San Antonio, Texas. The program consisted of eight training workshops, home visits, and a validation. Workshop topics included: space to play and learn, health and safety, growth and…

The comparative effects of various sequences of test items were examined for over 900 graduate students enrolled in an educational research course at The University of Alabama, Tuscaloosa. experiment, which was conducted a total of four times using four separate tests, presented three different arrangements of 50 multiple-choice items: (1)…