The problem of sex bias in mathematics word problems is discussed, with references to the appropriate literature. Word problems are assessed via cognitive science analysis of word problem solving. It has been suggested that five basic semantic relations are adequate to classify nearly all story problems, namely, change, combine, compare, vary, and…

The Test Analysis Package (TAP) consists of three microcomputer programs that edit, score, summarize, and analyze student test data. Features of the TAP system include: (1) an editor that allows creation of a student test data file without the use of a separate word processor; (2) a scoring mechanism that can score a test data file of 999 students…

A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

A formal analysis is presented of the effects of item deletion on equating/scaling functions and reported score distributions. The phrase "item deletion" refers to the process of changing the original key of a flawed item to either all options correct, including omits, or to no options correct, i.e., not scoring the flawed item. There…

A model and method for developing a valid and reliable paper-and-pencil test for evaluating the technical knowledge of baseball coaches in the National Coaching Certification Program (NCCP) in Canada are discussed. Development of a general theoretical and operational model for the evaluation of NCCP coaches in all sports are also studied. The…

Computer programs are presented to plot item and test characteristic curves and item information functions for parameter estimates produced by the LOGIST and BICAL computer programs. These programs provide data in tabular format, but their usefulness in test development and measurement courses can be greatly enhanced by graphic plots of the item…

This study assesses the accuracy of ASCAL, a microcomputer-based program for estimating item parameters for the three-parameter logistic model in item response theory. Item responses are generated from a three-parameter model, and item parameter estimates from ASCAL are compared to the generating item parameters and to estimates produced by…

A study examined the nature of the questions contained in two major standardized reading comprehension tests in terms of their centrality to the text. It was hypothesized that the use of a discrimination index for item selection would tend to favor relatively trivial questions. Half the reading selections from the Stanford Diagnostic Reading Test…

A common problem arises in scale transformation when independent estimates of item parameters from two separate data sets must be expressed in the same metric. These item parameter estimates will be different because the metric or scale defined by each independent calibration of the items is different. The problem is frequently confronted in…

The multilevel characteristics of test item data are considered as a method for examining the characteristics of standardized norm-referenced tests. A theoretical rationale for examining multilevel characteristics is presented. It can be used as an aid to understand why program and instructional effects on measures constructed from…

In a study of the usefulness of the Rasch model for examining tests for possible bias, 102 native Spanish-speaking and 104 native English-speaking preschool four-year-olds in a remedial education program were administered Spanish and English versions of the Cooperative Preschool Inventory, a standardized measure of school readiness, The Rasch…

Differential item performance (DIP) is discussed as a concept that does not necessarily imply item bias or unfairness to subgroups of examinees. With curriculum-based achievement tests, DIP is presented as a valid reflection of group differences in requisite skills and instruction. Using data from a national testing of the ACT Assessment, this…

A tailored testing model employing the beta distribution, whose mean equals the difficulty of an item and whose variance is approximately equal to the sampling variance of the item difficulty, and employing conditional item difficulties, is proposed. (Author)

A method for determining invariant item parameters is presented, along with a scheme for obtaining test scores which are interpretable in terms of a common metric. The method assumes a unidimensional latent trait and uses a three parameter normal ogive model. The assumptions of the model are explored, and the methods for calculating the proposed…

This paper follows the evaluation of a system of student performance analyses programs which has advanced from a crude manual system to an easy to use, on-line, interactive system. Recently, emphasis has focused upon the development of a system which requires little computer expertise on the part of the author to obtain a concise, easy to read…