Three variations of a least squares regression model are presented that are suitable for determining and correcting for rating error in designs in which examinees are evaluated by a subset of possible raters. Models are applied to ratings from 4 administrations of a medical certification examination in which 40 raters and approximately 115…

The seven cohort studies of the relation between prenatal and postnatal exposure to polychlorinated biphenyls (PCBs) to cognitive, neuropsychological and behavioral development have suggested that exposure to PCBs can cause persistent changes in cognitive functioning. D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow (this issue) apply six scientific…

The analytically derived asymptotic standard errors (SEs) of maximum likelihood (ML) item estimates can be approximated by a mathematical function without examinees' responses to test items, and the empirically determined SEs of marginal maximum likelihood estimation (MMLE)/Bayesian item estimates can be obtained when the same set of items is…

Often quantitative data in the social sciences have only ordinal justification. Problems of interpretation can arise when least squares multiple regression (LSMR) is used with ordinal data. Two ordinal alternatives are discussed, dominance-based ordinal multiple regression (DOMR) and proportional odds multiple regression. The Q[superscript 2]…

Establishing stability, defined as observing minimal measurement error in a test-retest assessment, is vital to validating psychometric tools. Correlational methods, such as Pearson product-moment, intraclass, and kappa are tests of association or consistency, whereas stability or reproducibility (regarded here as synonymous) assesses the…

Social constructivist theories of race suggest no two measures of race will capture the same information, but the degree of "error" this creates for quantitative research on inequality is unclear. Using unique data from the General Social Survey, I find observed and self-reported measures of race yield substantively different results when used to…

Two local methods for observed-score equating are applied to the problem of equating an adaptive test to a linear test. In an empirical study, the methods were evaluated against a method based on the test characteristic function (TCF) of the linear test and traditional equipercentile equating applied to the ability estimates on the adaptive test…

Purpose: In this study the levels of staff turnover reported in the nursing home literature (1990-2003) are reviewed, as well as the definitions of turnover used in these prior studies. With the use of primary data collected from 354 facilities, the study addresses the various degrees of bias that result, depending on how staff turnover is defined…

In this technical report, the authors describe the development alternate forms of three types of early literacy measures as part of a comprehensive progress monitoring literacy assessment system developed in 2006 for use with students in Kindergarten through fourth grade. They begin with a brief overview of the two conceptual frameworks underlying…

The National Household Education Survey (NHES) was conducted for the first time in 1991 as a way to collect data on the early childhood education experiences of young children and participation in adult education. Because the NHES methodology is relatively new, field tests were necessary. A large field test of approximately 15,000 households was…

Direct assessments of the accuracy with which raters can use a rating instrument are presented. This study demonstrated how surplus behavioral incidents scaled during the development of Behaviorally Anchored Rating Scales (BARS) can be used effectively in the evaluation of the newly developed scales. Construction of scenarios of hypothetical…

Effect sizes have been increasingly emphasized in research as more researchers have recognized that: (1) all parametric analyses (t-tests, analyses of variance, etc.) are correlational; (2) effect sizes have played an important role in meta-analytic work; and (3) statistical significance testing is limited in its capacity to inform scientific…

Lenders' billings for interest subsidy payments under the Department of Education's Guaranteed Student Loan Program (GSLP) are discussed. In fiscal year 1986, the Department of Education paid lenders $2.4 billion in interest subsidies on $39 billion of outstanding Guaranteed Student Loans. The General Accounting Office (GAO) reviewed the accounts…

The 1990 National Assessment of Educational Progress (NAEP) will mark the first time that state-level comparisons will be possible with NAEP data. The 1990 data will contain, as a trial component, state-level assessments of eighth graders in mathematics. Mathematics and reading comparisons for fourth graders will be added in 1992. Statistical…

The general linear model was described, and the influence that measurement errors have on model parameters was discussed. In particular, the assumptions of classical true-score theory were used to develop algebraic relationships between the squared multiple correlations coefficient and the regression coefficients in the infallible and fallible…