This is the final test for students in the twelfth-grade course Mathematics 30, offered in schools in Alberta, Canada. Intended for administration in June 1986, it is available in both English and French. It contains 52 multiple-choice questions and five written-response problems, with two-and-one-half hours allowed for completion. Approved…

The item difficulty and item discrimination of three multiple-choice item formats were compared in experimental and non-experimental settings. In the experimental study, 104 graduate students were randomly assigned to complete one of three forms of a multiple-choice test: (1) a complex alternative ("none of the above") as the correct answer; (2) a…

When learning is taking place, students test their hypotheses and evaluate them, and modify their current theories on the basis of new information. This phenomenon is known as "hypothesis testing view" or "theory changes." Many students change their rules to another while they are taking a test. This study introduced a new…

The purpose of this study was to evaluate the use of log-linear models in detecting test item bias. The evaluation of the log-linear approach in this regard will focussed on the following: (1) the stability of the procedure across replications--the effect of sampling error across random samples of ethnic groups; (2) the amount of artifactual…

A technique for detecting item bias that is responsive to attitudinal measurement considerations is a maximum likelihood factor analysis procedure comparing multivariate factor structures across various subpopulations, often referred to as SIFASP. The SIFASP technique allows for factorial model comparisons in the testing of various hypotheses…

The objectives for this study were to: (1) develop a valid, reliable measure of test-wiseness with equivalent forms for use with students in the health sciences; and (2) determine the level of test-wiseness of entering medical students. The test-wiseness areas included in this study were: similar options, umbrella term, item give-away, convergence…

"Outlier studies" identify items for which extreme differences in performance by contrasting groups occur; these extreme items are the "outliers" referred to. Review of the studies conducted on tests receiving major use in higher education reveals that though one cannot make a priori classifications of outliers with confidence,…

Despite the popularity of both multiple-choice (MC) and true-false (TF) items, most investigations comparing the two formats have done so to determine the optimum number of choices to be given to students within a given time period. The purpose of this investigation was to compare the reliabilities and the validities of both formats when the items…

This study examines item bias on Forms L and M of the Peabody Picture Vocabulary Test-Revised (PPVT-R) for 132 Anglo-American and Mexican-American children in grades one through four. Analyses of variance were employed to assess item bias as defined by items x ethnicity interactions. Follow-up analyses were performed using a Bonferroni-type…

This study compared the item difficulty and item discrimination of three multiple choice item formats. The multiple choice formats studied were: a complex alternative (none of the above) as the correct answer; a complex alternative as a foil, and the one-correct answer format. One hundred four graduate students were randomly assigned to complete…

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

This package consists of an information booklet for job candidates preparing to take California's Corrections Officer Examination and a user's manual intended for those who will administer the examination. The candidate information booklet provides background information about the development of the Corrections Officer Examination, describes its…

This report presents an analysis of the content validity of a series of secondary school mathematics tests designed by university mathematicians in California to help improve the articulation between secondary and postsecondary mathematics instruction. The purpose in conducting this analysis was to improve understanding of what it means to…

In order to evaluate our methods and approaches of estimating the operating characteristics of discrete item responses, it is necessary to try other comparable methods on similar sets of data. LOGIST 5 was taken up for this reason, and was tried upon the hypothetical test items, which follow the normal ogive model and were used frequently in…

On well-constructed multiple-choice tests, the most serious threat to measurement is not variation in item discrimination, but the guessing behavior that may be adopted by some students. Ways of ameliorating the effects of guessing are discussed, especially for problems in latent trait models. A new item response model, including an item parameter…