The majority of states include value-added models (VAMs) or some other measure of student academic growth as a component of their teacher evaluation systems. However, there is considerable disagreement among researchers about whether states and school districts should use student growth measures to make high-stakes personnel decisions. Many…

This article proposes a latent variable regression four-level hierarchical model (LVR-HM4) that uses a fully Bayesian approach. Using multisite multiple-cohort longitudinal data, for example, annual assessment scores over grades for students who are nested within cohorts within schools, the LVR-HM4 attempts to simultaneously model two types of…

Item response models typically assume that the item characteristic (step) curves follow a logistic or normal cumulative distribution function, which are strictly monotone functions of person test ability. Such assumptions can be overly-restrictive for real item response data. We propose a simple and more flexible Bayesian nonparametric IRT model…

When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical…

Intraclass correlations are used to summarize the variance decomposition in populations with multilevel hierarchical structure. There has recently been considerable interest in estimating intraclass correlations from surveys or designed experiments to provide design parameters for planning future large-scale randomized experiments. The large…

Due to budgetary concerns, the FDOE restructured the Writing portion of the FCAT assessment program for 2010. Among the changes was a difference in how the writing essays were scored. In the past, two people independently judged each essay and each assigned a score from 1 to 6. In the event of a disagreement between judges, the average of the…

Pretest-posttest experimental designs often are used in randomized control trials (RCTs) in the education field to improve the precision of the estimated treatment effects. For logistic reasons, however, pretest data often are collected after random assignment, so that including them in the analysis could bias the posttest impact estimates. Thus,…

There is an increasing interest in using longitudinal measures of student achievement to estimate individual teacher effects. Current multivariate models assume each teacher has a single effect on student outcomes that persists undiminished to all future test administrations (complete persistence [CP]) or can diminish with time but remains…

Large-scale testing programs involving classification decisions typically have multiple forms available and conduct equating to ensure cut-score comparability across forms. A test developer might be interested in the extent to which an examinee who happens to take a particular form would have a consistent classification decision if he or she had…

Value-added models of student achievement have received widespread attention in light of the current test-based accountability movement. These models use longitudinal growth modeling techniques to identify effective schools or teachers based upon the results of changes in student achievement test scores. Given their increasing popularity, this…

KeyMath Revised was devised as a power test for use with students from kindergarten through grade 9. The test is divided into three dimensions: basic concepts, operations, and applications. This paper describes the test's administration, summation of data, standardization, reliability, and validity. (JDD)

In revisions due to be implemented in 1994, the Scholastic Aptitude Test (SAT) will emphasize critical reading skills and mathematical computation more, and test takers will be allowed to use calculators. The College Entrance Examination Board's Achievement Tests will also be overhauled, with new subject tests added and current test format and…

Discusses the status of the testing of computational estimation. Suggests ideas to promote needed immediate actions and examines issues related to effective assessment of computational estimation. (PK)