Games (1973) criticized the Marascuilo and Levin (1970) "nested" or simple effects design as a poor substitute for the usual logic of a factorial analysis of variance. Marascuilo and Levin's use of "nesting" is completely idiosyncratic and contrary to well-established usage, thus confusing the student. Proper usage is…

One aspect of multiple regression--the shrinkage of the multiple correlation coefficient on cross-validation is reviewed. The paper consists of four sections. In section one, the distinction between a fixed and a random multiple regression model is made explicit. In section two, the cross-validation paradigm and an explanation for the occurrence…

Generally, ratings have notoriously low inter-rater reliabilities. Because of differences in orientation, background, and expectations, ratings are seldom made from the same point of reference; thus, many types of error mask the true rating variance. Guilford's technique identified most types of constant error by analysis of variance and then…

Three procedures used to control Type I error rate in stepwise regression analysis are forward selection, backward elimination, and true stepwise. In the forward selection method, a model of the dependent variable is formed by choosing the single best predictor; then the second predictor which makes the strongest contribution to the prediction of…

Campbell (l969) argued for the interrupted time-series experiment as a useful methodology for testing intervention effects in the social sciences. The validity of the statistical hypothesis testing of time-series, is, however, dependent upon the proper identification of the underlying stochastic nature of the data. Several types of model…

A procedure is presented for the analysis of rating data with correlated intrajudge and uncorrelated interjudge measurement errors. Correlations between true scores on different rating dimensions, reliabilities for each judge on each dimension and correlations between intrajudge errors can be estimated given a minimum of three raters and two…

False-positive and false-negative dicisions are the fundamental errors committed with a mastery test; yet the estimation of the likelihood of committing these errors has not been investigated. Accordingly, two methods of estimating the likelihood of committing these errors are described and then investigated using Monte Carlo techniques.…

This study introduced a probabilistic model utilizing item response theory (IRT) for dealing with a variety of misconceptions. The model can be used for evaluating the transition behavior of error types, advancement of learning stages, or the stability and persistence of particular misconceptions. Moreover, it apparently can be used for relating…

Three statistical problems related to criterion-referenced testing are investigated: estimation of the likelihood of a false-positive or false-negative decision with a mastery test, estimation of true scores in the Compound Binomial Error Model, and comparison of the examinees to a control. Two methods for estimating the likelihood of…

This study used the Montague-Riley Test to introduce a new scoring procedure that revealed errors in cognitive processes occurring at subcomponents of an electricity problem. The test, consisting of four parts with 36 open-ended problems each, was administered to 250 high school students. A computer program, ELTEST, was written applying a…

Failure to consider errors of measurement when using partial correlation or analysis of covariance techniques can result in erroneous conclusions. Certain aspects of this problem are discussed and particular attention is given to issues raised in a recent article by Brewar, Campbell, and Crano. (Author)

Synthetic estimation is a statistical technique that estimates small-area statistics by combining national estimates of the relevant characteristics with estimates of other known characteristics of the small geographic area. The advantages of the synthetic estimation approach to local estimation are its intuitive appeal, its simplicity, and its…

The development of the error prone model (EPM) for the 1984-1985 student financial aid validation criteria for Pell Grant recipient selection is discussed, based on a comparison of the 1983-1984 EPM criteria and a newly estimated EPM. Procedures/assumptions on which the new EPM was based include: a sample of 1982-1983 Pell Grant recipients…

The development of a number of error-prone models to select Pell Grant recipients for validation is discussed. The 1983-1984 Pell Grant validation strategy consists of a two-stage approach: selection using Pre-Established Criteria (PEC) followed by selection using Error Prone Modeling (EPM). The database used for model development consists of a…