The accuracy of trait estimates obtained from three vertical equating methods was examined. The procedures studied included two anchor test designs and a single-group design. Data from two content areas and two grade combinations were studied. A three-parameter logistic model was used to perform the equatings. The results obtained were used to…

In this report, selection theory is used as a theoretical framework from which mathematical algorithms for tailored testing are derived. The process of tailored, or adaptive, testing is presented as analogous to personnel selection and rejection on a series of continuous variables that are related to ability. Proceeding from a single common-factor…

Two iterative procedures for constructing Rasch scales are presented. A log-likelihood ratio test based on a quasi-loglinear formulation of the Rasch model is given by which one item at a time can be deleted from or added to an initial item set. In the so-called "top-down" algorithm, items are stepwise deleted from a relatively large…

Problems associated with the analysis of data collected using the Solomon Four Group Design are discussed. The design includes an experimental group and a control group that have been pretested and posttested, and an experimental and a control group that have been posttested only. A sample problem is approached in three different ways. First, the…

A communication model suggests that in almost all cases where dissemination and utilization of knowledge has taken place, one or more of seven general factors can be identified as having been active in aiding the phenomena. The proposed factors are: linkage, structure, capacity, openess, reward, proximity, and synergy. In order to use this model…

The problem of spurious significance in multivariate exploratory research is discussed. When a very large number of statistical tests are performed, many tests will be significant on the basis of chance alone. To counter this problem, the use of two sign tests to analyze sets of results has been suggested; the chance expectation [CE test] assesses…

Few phenomena in psychology have been studied more than reaction time. However, while response latency now provides the basic data for research in many areas of cognitive psychology, little work has been done on the problem of incorporating response latency in the measurement of individual differences. A solution to this problem requires the…

This publication describes some of the work of the UNESCO Division of Statistics on Education on the evaluation of the internal efficiency of educational systems that followed from the 1970 International Conference on Education. The first section contains a brief summary of the conclusions of the "Expert Meeting on the Evaluation of Internal…

Educational outcomes are affected by student level, classroom level, and school level characteristics. The fact that educational data are multilevel in nature poses serious analysis questions. Though strong arguments can be made for focusing on a single level of analysis, such studies have several basic limitations: the choice of analytic level…

It is shown that empirical mental test P - P plots are approximately equal to theoretical item-item curves, at least for long tests administered to many people. This result is important because it leads to (1) a distribution free method for estimating points on item-item curves; (2) a general method for defining estimates of item parameters; and…

To the data analyst, outliers can present both a problem and an opportunity. Stray or outlying observations can severly distort estimates of a distribution's central tendency (like the mean) and estimates of one variable's relationship to another (like the regression coefficient). These problems are frequent and serious, and as a result,…

Three methods that can be used subsequent to a regression analysis to determine the relative effectiveness of schools are Dyer's Performance Indices, Scheffe's hyperbolic confidence bands, and Gafarian's linear confidence bands. These methods were applied to data from 54 hypothetical schools randomly generated from a multivariate normal…

This study compared three approaches to the two-factor experiment with repeated measures on one factor: (1) the conventional mixed model analysis of variance, (2) the Greenhouse-Geisser conservative analysis of variance, and (3) multivariate extensions of analysis of variance. Computer simulated data were used in a total of 96 sets of covariance…

To determine if Rasch Model procedures have any utility for equating pre-existing tests, data from the equating phase of the Anchor Test Study (ATS) were reanalyzed. This management report summarizes the work completed in the project, describes the differences in this project and that of the ATS, and presents recommendations and conclusions to the…

The reliability of a criterion referenced test was defined as a measure of the degree to which the test discriminates between an individual's level of performance and a predetermined criterion level. The variances of observed and true scores were defined as the squared deviation of the score from the criterion. Based on these definitions and the…