The study compared two promising item response theory (IRT) item-selection methods, optimal and content-optimal, with two non-IRT item selection methods, random and classical, for use in fixed-length certification exams. The four methods were used to construct 20-item exams from a pool of approximately 250 items taken from a 1985 certification…

The Vocational Interest Survey (VIS) is a set of six questionnaire scales for measuring vocational interest. It is designed for Australian users and is consistent with Holland's theory that there are six basic career categories. This paper discusses the development of the VIS and presents some technical data on the questionnaires. Items were…

This paper describes a computer program in Microsoft BASIC which selects and administers test items from a small item bank. The level of the difficulty of the item selected depends on the test taker's previous response. This adaptive system is based on the Rasch model. The Rasch model uses a unit of measurement based on the logarithm of the…

A multiple choice achievement test was constructed in which both cognitive level and degree of abstractness were controlled. Subjects were 75 students from a major university in the Southwest. A group of 13 judges, also university students, classified the concepts for degree of abstractness. Results indicated that both cognitive level and degree…

In some testing programs an early item analysis is performed before final scoring in order to validate the intended keys. As a result, some items which are flawed and do not discriminate well may be keyed so as to give credit to examinees no matter which answer was chosen. This is referred to as allkeying. This research examined how varying the…

Item analysis data fitting the normal ogive model were simulated in order to investigate the problems encountered when applying the three-parameter logistic model. Binary item tests containing 10 and 35 items were created, and Monte Carlo methods simulated the responses of 2,000 and 500 examinees. Item parameters were obtained using Logist 5.…

Student achievement test scores were compared and equated, using three different testing methods: paper-administered, computer-administered, and computerized adaptive testing. The tests were developed from third and sixth grade mathematics item banks of the California Assessment Program. The paper and the computer-administered tests were identical…

This paper discusses the theoretical scope and practical applicability of generalizability (G) theory through the principle of symmetry. Major ideas are summarized and factors hindering applications of G theory in research conducted in French-speaking Europe are presented. The principle of symmetry affirms that any factor of a design can be…

This paper describes the development of the Basic Educational Skills Test (BEST) in the Austin Independent School District. In 1982 future options for the AISD minimum competency program, which requires all students to meet minimum proficiency levels in reading and mathematics before graduation, were evaluated against legal and local criteria. It…

Four item bias methods were studied. The methods compared include the Mantel-Haenszel statistic, the plot method, the route mean squared difference method, and the total area method; the latter two methods are based on item response theory. The test consisted of item responses of 451 male and 486 female ninth graders to 75 test items on the 1985…

This paper describes the development of a language arts test to assess the consistency of student response patterns and the feasibility of using the test to diagnose students' misconceptions. The studies were part of a project to develop computerized adaptive testing for the language arts with software to diagnose student errors. The…

The purpose of this investigation was to examine the item characteristics of the General Educational Development Tests (GED) for specific subgroups of students. The method employed was the approach suggested by Linn and Harnisch in which the three-parameter logistic model is used for detecting interactions between item content and group…

Whether judges on bias review committees can identify test items that function differently for black and white examinees was studied. Judges (n=42) on three bias review committees were asked to examine a set of items and predict differential item functioning (DIF) without empirical data. Test items from teacher certification tests in the content…

This study sought to determine the cognitive levels of questioning of end-of-chapter test items accompanying selected fifth-grade science textbooks. The extent to which test items emphasized high level questioning and significant differences among texts in the distribution of knowledge and above-knowledge-level test items were also investigated.…

This study examined and refined a mathematics skills instrument used to predict success in an introductory statistics course and to measure improvement in mathematics skills. Alternate forms of a 28-item true-false test were administered as a pretest and posttest to 18 undergraduate and 19 graduate students enrolled in introductory educational…