The third section of this two-volume report examines the utility of the model developed in section I for application in a classroom testing situation. The model was applied in arithmetic classes through a weekly testing program. The teacher specified the generic task being taught, tests were constructed using a table of random numbers to select…

The competencies, item specifications, and sample items for the reading measures devised for the Wisconsin Competency-Based Testing Program are provided in this booklet. Following lists of reading competencies to be tested for grades three, seven, and ten, the booklet presents guidelines used in preparing the tests and test items; general item…

The purposes of the present study were to ascertain whether or not two particular formatting characteristics influenced seventh grade student performance on math tests. One research question focused on the effects of decimal positioning in multiple choice options for computational items. In a second question, labeling format was compared with…

Many researchers have suggested that the cause of differential item functioning (DIF) can in part be due to the misspecification of the supporting trait distribution (STD). This paper demonstrates how a unidimensional item response theory (IRT) calibration of response data, generated from a two-dimensional IRT model, results in DIF when the…

A method is proposed for the detection of item bias with respect to observed or unobserved subgroups. The method uses quasi-loglinear models for the incomplete subgroup x test score x item 1 x ... x item k contingency table. If the subgroup membership is unknown, the models are the incomplete-latent-class models of S. J. Haberman (1979). The…

The development and use of item shells in the construction of a series of standardized tests of reading comprehension at the elementary school level are described. An item shell is an item that is devoid of specific content, but contains key words and a distinctive syntactic structure. The specific content of the item shell varies depending on the…

The use of loglinear latent class models to detect item bias was studied. Purposes of the study were to: (1) develop procedures for use in assessing item bias when the grouping variable with respect to which bias occurs is not observed; (2) develop bias detection procedures that relate to a conceptually different assessed trait--a categorical…

The use of item response theory (IRT) is a prerequisite to successful use of computerized test systems. In item response models, as opposed to classical test theory, the abilities of the examinees and the properties of the items are parameterized separately. Therefore, when measuring the abilities of examinees, the model implicitly corrects for…

Increased emphasis on public school accountability has resulted in several states including a science component in their elementary and middle school testing program. This component often includes items designed to measure process skill ability. The purpose of this study was to examine the performance of high school students on four types of…

Extended caution indices (ECI) specify the degree of confidence that can be placed in an individual's test score by analyzing patterns of item response. Among the most promising of such indices are the standardized ECIs. Contrary to the literature, several instances were found, in a previous study, of nonnormal distributions of ECIs with samples…

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

This manual contains Progress Checks and Tests for use in a Solar Heating Systems curriculum (see note). It contains master copies of all Progress Checks and Unit Tests accompanying the curriculum, organized by unit. (The master copies are to be duplicated by each school so that adequate copies are available for student use in a self-paced student…

A strategy for overcoming problems with the Rasch model's inability to handle missing data involves a pairwise algorithm which manipulates the data matrix to separate out the information needed for the estimation of item difficulty parameters in a test. The method of estimation compares two or three items at a time, separating out the ability…

The HPI Texas Preschool Screening Inventory (TPSI) is a test to help determine which children might be a risk for learning problems as they enter kindergarten or first grade. The HPI Manual describes the procedure, score interpretation, and rationale for seven components of the test, including auditory memory for numbers and letters, visual memory…

Following instructions provided in the teacher's manual, the SCOPE Mathematics Achievement Test booklet for grades K-1 presents 11 mathematical concepts. Testing items include: building appropriate sets; matching equivalent sets; reproducing a given pattern; selecting and/or making an object that is bigger than or smaller than a given object;…