Investigated empirically through post mortem item-examinee sampling was the feasibility of the jackknife as a procedure for approximating standard errors of estimate in multiple matrix sampling. The parameters estimated were the mean test score, second through fourth central moments of the test score distribution, and the variance of the item…

A new formula is developed for the relative efficiency of two tests measuring the same trait. The formula expresses relative efficiency solely in terms of the standard errors of measurement and, surprisingly, the frequency distributions of true scores. Approximate methods for estimating relative efficiency may make this function routinely…

The concepts of elevation, scatter, and shape are investigated as parameters in assessing the similarity among profiles of individuals. A computational strategy for differentiating the independent contribution of each parameter to more global indices of resemblance is presented. (Author/JKS)

A test of significance for identifying individuals who are most influenced by an experimental treatment as measured by pre-post test change score is presented. The technique requires true difference scores, the reliability of obtained differences, and their standard error of measurement. (Author/JKS)

A simplification of Lord and Wingersky's method for computing the asymptotic variance-covariance matrix of maximum likelihood estimates for item and person parameters under some restrictions on the estimates is presented. Computation of the error variance-covariance matrix for the item parameters in the Rasch model is described. (NSF)

Unreliable profiles impose the difficulty that ordinal and interval relations among the individual's scores become uncertain or unstable. A profile reliability coefficient is derived to estimate the relative expected extent of this ordinal and interval "inversion" for any profile of K measures. (Author/DWH)

A direct proof is given for the generalized Spearman-Brown formula for any real multiple of test length. (Author)

The aim of this paper is to explore methods for evaluating the effects of randomized interventions in a longitudinal design. The focus is on methods for modeling the possibly nonlinear relationship between treatment effect and baseline and evaluating the treatment effect taking this nonlinear relationship into account. A control/treatment growth…

A study was conducted to identify local item dependence (LID) in the context-dependent item sets used in an examination prepared for use in an introductory university physics class and to assess the effects of LID on estimates of the reliability and standard error of measurement. Test scores were obtained for 487 students in the physics class. The…

This Digest describes four types of errors in mail surveys and summarizes the ways they can be reduced. Any one of these sources of error can make survey results unacceptable. Sampling error is examined through inferential statistics applied to sample survey results. In general, increasing sample size will decrease sampling error when simple…

The purpose of this study was to examine the potential impact of selected methodological factors on the validity of conclusions from reliability generalization (RG) studies. The study focused on four factors; (1) missing data in the primary studies; (2) transformation of sample reliability estimates; (3) use of sample weights for estimating mean…

An item response theory (IRT) model is used as a measurement error model for the dependent variable of a multilevel model where tests or questionnaires consisting of separate items are used to perform a measurement error analysis. The advantage of using latent scores as dependent variables of a multilevel model is that it offers the possibility of…

Single studies, by themselves, rarely explain the effect of treatments or interventions definitively in the social sciences. Researchers created meta-analysis in the 1970s to address this need. Since then, meta-analytic techniques have been used to support certain treatment modalities and to influence policymakers. Although these techniques…

A test which allows for errors of measurement is derived for the hypothesis that all the members of a population who possess a certain skill are a sub-set of the members who possess another skill. (Author)

Author supports the credibility of the propositions that: (1) the true component of a score is proportional to the number of equivalent elements that contribute to it. And, (2) the error component of a score is proportional to the square root of the number of equivalent elements that contribute to it. (Author/MB)