Educational accountability has grown substantially over the last decade, due in large part to the No Child Left Behind Act of 2001. Accordingly, educational researchers and policymakers are interested in the statistical properties of accountability models used for NCLB, such as status, improvement, and growth models; as well as others that are not…

The National Study on Alternate Assessments (NSAA) was mandated by the Individuals With Disabilities Education Improvement Act of 2004 (IDEA). Specifically, the law called for a "Study on Ensuring Accountability for Students Who Are Held to Alternative Achievement Standards" to examine: (1) the criteria that states use to determine…

Holland's theory of six work personalities has become a staple of vocational psychology, providing a robust and simple model for understanding the structure of vocational interests. Though Holland's types provide a common vocabulary for vocational psychologists working with a variety of populations, until this point there has not been a measure of…

We developed alternate forms of a math test for use in both screening students at risk of failure and monitoring their progress over time. In this technical report, we present results of the screener, used in the fall of 2009. The 48-item test was aligned to the National Council of Teachers of Mathematics (NCTM) Curriculum Focal Point Standards…

The recent "Nationwide academic achievement and study situation survey" was clearly influenced by the idea of "authentic assessment", an educational assessment perspective focused on "quality" and "engagement". However, when "performance assessment", the assessment method corresponding to this…

In this article, I specify a conceptual framework for test validity research on content assessments taken by English language learners (ELLs) in U.S. schools in grades K-12. This framework is modeled after one previously delineated by Willingham et al. (1988), which was developed to guide research on students with disabilities. In this framework…

The purpose of this study is to determine (1) whether the previously observed vulnerability of WISC subtests to tester effects appeared under ordinary testing conditions, and (2) which subtests were most susceptible to these effects. Results support the presence of both general and differential vulnerability of subtests. (Author)

For classical, norm-referenced test reliability, Cronbach's alpha has been shown to be equal to the mean of all possible split-half Pearson product-moment correlation coefficients, adjusted by the Spearman-Brown prophecy formula. For criterion-referenced test reliability, in an analogous vein, this paper provides the rationale behind, the analysis…

Three successively simpler formulas for approximating the standard error of measurement were derived by applying successively more simplifying assumptions to the standard formula based on the standard deviation and the Kuder-Richardson formula 20 estimate of reliability. The accuracy of each of these three formulas, with respect to the standard…

Two designs for comparing a judge's ratings with a known standard are compared: (1) Subjects are categorized into classes, with no knowledge of the size of either group; and (2) the judge is told the actual number allowed in each class. The probability distribution of the total number of correct choices is developed for each case, and their power…

A comparison of three multivariate models (canonical reliability model, maximum generalizability model, canonical correlation model) for estimating test battery reliability indicated that the maximum generalizability model showed the least degree of bias, smallest errors in estimation, and the greatest relative efficiency across all experimental…

Current methods for obtaining reliability indices for mastery tests can be laborious. This paper offers practitioners tables from which agreement and kappa coefficients can be read directly and provides criterion for acceptable values of agreement and kappa coefficients. (TJH)