Value added models (VAMs) attempt to estimate the causal effects of teachers and schools on student test scores. We apply Generalizability Theory to show how estimated VA effects depend upon the selection of test items. Standard VAMs estimate causal effects on the items that are included on the test. Generalizability demands consideration of how…

There is an enduring issue on whether student- and school-level covariates should be included in value-added school effects models, in addition to prior achievement. Proponents argue that the addition of covariates allows fairer comparisons of schools, whereas opponents argue that it excuses poorly performing schools and obscures policy-relevant…

Education systems focus on issues related to school effects and differences. School effects are used as a basis for accountability in various countries including China. This study investigated the stability and cross-disciplinary consistency of value-added estimates based on student scores in selected schools in a city in central China. The…

The traditional approach to estimating the consistency of school effects across subject areas and the stability of school effects across time is to fit separate value-added multilevel models to each subject or cohort and to correlate the resulting empirical Bayes predictions. We show that this gives biased correlations and these biases cannot be…

Value-added (VA) measures are currently the predominant approach used to compare the effectiveness of schools. Recent educational effectiveness research, however, has developed alternative approaches including the regression discontinuity (RD) design, which also allows estimation of absolute school effects. Initial research suggests RD is a viable…

The current study explored the size, stability, and consistency of school effects, using 2 effectiveness indicators: achievements of students at the end of primary school and growth in achievement across 3 years of schooling. The sample consisted of the scores of 25,269 students on 3 subjects, taken in Grades 4 to 6 among 3 cohorts in 319 primary…

Value-added "Progress" measures are to be introduced for all English schools in 2016 as "headline" measures of school performance. This move comes despite research highlighting high levels of instability in value-added measures and concerns about the omission of contextual variables in the planned measure. This article studies…