In this study, we estimated the relationship between two popular measures of teacher effectiveness--teachers' value-added model (VAM) estimates, represented in this study via median growth percentiles (MGPs), and teachers' observational scores, derived from the TAP System for Teacher and Student Advancement. We examined the relationship between…

Until recently, legal challenges to using value-added models (VAMs) throughout the United States (US) for high-stakes teacher evaluative decisions (e.g., merit pay, tenure, and termination) were unsuccessful, especially in the state of Florida. Hence, prior and still, multiple teachers throughout Florida have been terminated or involuntarily…

Advocates for the use of a multi-measure system of performance evaluation argue that multiple measures may better capture meaningful differences in employee effectiveness and help align effort with organizational objectives. This may be particularly important in organizations such as schools that produce multiple outcomes. In this paper I use a…

School value-added models are widely applied to study, monitor, and hold schools to account for school differences in student learning. The traditional model is a mixed-effects linear regression of student current achievement on student prior achievement, background characteristics, and a school random intercept effect. The latter is referred to…

School accountability systems increasingly hold schools to account for their performances using value-added models purporting to measure the effects of schools on student learning. The most common approach is to fit a linear regression of student current achievement on student prior achievement, where the school effects are the school means of the…

This paper examines how different measures of teacher quality are related to students' long-run educational trajectories. We estimate teachers' "test-based" and "nontest" value-added (the latter based on contributions to student absences, suspensions, grade progression, and grades) and assess how these predict various student…

In this study, researchers compared the concordance of teacher-level effectiveness ratings derived via six common generalized value-added model (VAM) approaches including a (1) student growth percentile (SGP) model, (2) value-added linear regression model (VALRM), (3) value-added hierarchical linear model (VAHLM), (4) simple difference (gain)…

Nations, states, and districts must choose among an array of different approaches to measuring school effectiveness in implementing their accountability policies, and the choice can be difficult because different approaches yield different results. This study compares two approaches to computing school effectiveness: a "beating the odds"…

Value-added (VA) modeling can be used to quantify teacher and school effectiveness by estimating the effect of pedagogical actions on students' achievement. It is gaining increasing importance in educational evaluation, teacher accountability, and high-stakes decisions. We analyzed 370 empirical studies on VA modeling, focusing on modeling and…

Extension professionals face challenges in quantifying the impact of their efforts in advancing the decision-making process inherent in setting natural resources policy. We developed a flexible tool that measures the impact of improving decision makers' planning efforts. The tool consists of two sets of survey questions that can be modified to fit…

This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student's capacity to signal their assigned teacher's quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity…

The federal Race to the Top competition provided significant impetus for states to adopt value-added models as a part of their teacher evaluation systems. Such models typically link students to their teachers in the spring semester when statewide tests are administered and estimate a teacher's performance based on his or her students' learning…

Academic reviews take on new directions in an ever-increasing fast-paced development. Unit reviewers should be provided different samples, with varied cultural contents also providing nuances, as related to the 'object' of the evaluation, as well as a final overall product, i.e. more of a synthesis, through which one will check the degree of…

Recently, interest in test subscore reporting for diagnosis purposes has been growing rapidly. The two simulation studies here examined factors (sample size, number of subscales, correlation between subscales, and three factors affecting subscore reliability: number of items per subscale, item parameter distribution, and data generating model)…

This paper reports on a study of collaborative group work in mathematics. Although collaborative group work is known as one of the important approaches in education, it is still uncertain how group thinking can be measured in various learning contexts. We used the Group Thinking Measure (GTM) test developed by [Wegerif, R., T. Fujita, J. Doney, J.…