A formal analysis is presented of the effects of item deletion on equating/scaling functions and reported score distributions. The phrase "item deletion" refers to the process of changing the original key of a flawed item to either all options correct, including omits, or to no options correct, i.e., not scoring the flawed item. There…

A model and method for developing a valid and reliable paper-and-pencil test for evaluating the technical knowledge of baseball coaches in the National Coaching Certification Program (NCCP) in Canada are discussed. Development of a general theoretical and operational model for the evaluation of NCCP coaches in all sports are also studied. The…

Computer programs are presented to plot item and test characteristic curves and item information functions for parameter estimates produced by the LOGIST and BICAL computer programs. These programs provide data in tabular format, but their usefulness in test development and measurement courses can be greatly enhanced by graphic plots of the item…

This study assesses the accuracy of ASCAL, a microcomputer-based program for estimating item parameters for the three-parameter logistic model in item response theory. Item responses are generated from a three-parameter model, and item parameter estimates from ASCAL are compared to the generating item parameters and to estimates produced by…

A study examined the nature of the questions contained in two major standardized reading comprehension tests in terms of their centrality to the text. It was hypothesized that the use of a discrimination index for item selection would tend to favor relatively trivial questions. Half the reading selections from the Stanford Diagnostic Reading Test…

A common problem arises in scale transformation when independent estimates of item parameters from two separate data sets must be expressed in the same metric. These item parameter estimates will be different because the metric or scale defined by each independent calibration of the items is different. The problem is frequently confronted in…

The multilevel characteristics of test item data are considered as a method for examining the characteristics of standardized norm-referenced tests. A theoretical rationale for examining multilevel characteristics is presented. It can be used as an aid to understand why program and instructional effects on measures constructed from…

In a study of the usefulness of the Rasch model for examining tests for possible bias, 102 native Spanish-speaking and 104 native English-speaking preschool four-year-olds in a remedial education program were administered Spanish and English versions of the Cooperative Preschool Inventory, a standardized measure of school readiness, The Rasch…

Differential item performance (DIP) is discussed as a concept that does not necessarily imply item bias or unfairness to subgroups of examinees. With curriculum-based achievement tests, DIP is presented as a valid reflection of group differences in requisite skills and instruction. Using data from a national testing of the ACT Assessment, this…

A tailored testing model employing the beta distribution, whose mean equals the difficulty of an item and whose variance is approximately equal to the sampling variance of the item difficulty, and employing conditional item difficulties, is proposed. (Author)

A method for determining invariant item parameters is presented, along with a scheme for obtaining test scores which are interpretable in terms of a common metric. The method assumes a unidimensional latent trait and uses a three parameter normal ogive model. The assumptions of the model are explored, and the methods for calculating the proposed…

This paper follows the evaluation of a system of student performance analyses programs which has advanced from a crude manual system to an easy to use, on-line, interactive system. Recently, emphasis has focused upon the development of a system which requires little computer expertise on the part of the author to obtain a concise, easy to read…

One hundred eighty one sets of black twins and 223 sets of white twins provided responses to four 12-item subtests of the Raven's Progressive Matrices Test, Standard Version. The children were in elementary school and their item response patterns were analyzed with the use of revised ordering-theoretic methods to search for best-fitting…

The Time-shared Interactive Computer-Controlled Information Television (TICCIT) system represents a considerable technological advance over previous CAI systems, primarily because of its unprecedented foundation in instructional theory. This paper briefly describes the theory-base of the TICCIT system; it summarizes some recent advances in…

Analyses of student responses to Introductory Psychology test questions were discussed. The publisher supplied a two thousand item test bank on computer tape. Instructors selected questions for fifteen item tests. The test questions were labeled by the publisher as factual or conceptual. The semester course used a mastery learning format in which…