In this study, we estimated the relationship between two popular measures of teacher effectiveness--teachers' value-added model (VAM) estimates, represented in this study via median growth percentiles (MGPs), and teachers' observational scores, derived from the TAP System for Teacher and Student Advancement. We examined the relationship between…

Until recently, legal challenges to using value-added models (VAMs) throughout the United States (US) for high-stakes teacher evaluative decisions (e.g., merit pay, tenure, and termination) were unsuccessful, especially in the state of Florida. Hence, prior and still, multiple teachers throughout Florida have been terminated or involuntarily…

Local education agencies (LEAs) continue to use value-added models (VAMs) for teacher evaluation policies and purposes, often with consequences attached. Although the Every Student Succeeds Act (ESSA) provides more flexibility to LEAs, few have discontinued VAM use, suggesting they interpret VAMs as a valid measure of teacher effectiveness. In…

School value-added models are widely applied to study, monitor, and hold schools to account for school differences in student learning. The traditional model is a mixed-effects linear regression of student current achievement on student prior achievement, background characteristics, and a school random intercept effect. The latter is referred to…

School accountability systems increasingly hold schools to account for their performances using value-added models purporting to measure the effects of schools on student learning. The most common approach is to fit a linear regression of student current achievement on student prior achievement, where the school effects are the school means of the…

In this study, researchers compared the concordance of teacher-level effectiveness ratings derived via six common generalized value-added model (VAM) approaches including a (1) student growth percentile (SGP) model, (2) value-added linear regression model (VALRM), (3) value-added hierarchical linear model (VAHLM), (4) simple difference (gain)…

Recent lawsuits reveal common mistakes plaguing current teacher evaluation systems. Drawing on arguments in court documents for prominent cases, the authors find that evaluation systems using value-added measures (VAM) suffer from a) inconsistent and unreliable teacher ratings, b) bias toward and against teachers of certain types of students, c)…

Nations, states, and districts must choose among an array of different approaches to measuring school effectiveness in implementing their accountability policies, and the choice can be difficult because different approaches yield different results. This study compares two approaches to computing school effectiveness: a "beating the odds"…

Value-added (VA) modeling can be used to quantify teacher and school effectiveness by estimating the effect of pedagogical actions on students' achievement. It is gaining increasing importance in educational evaluation, teacher accountability, and high-stakes decisions. We analyzed 370 empirical studies on VA modeling, focusing on modeling and…

Extension professionals face challenges in quantifying the impact of their efforts in advancing the decision-making process inherent in setting natural resources policy. We developed a flexible tool that measures the impact of improving decision makers' planning efforts. The tool consists of two sets of survey questions that can be modified to fit…

The federal Race to the Top competition provided significant impetus for states to adopt value-added models as a part of their teacher evaluation systems. Such models typically link students to their teachers in the spring semester when statewide tests are administered and estimate a teacher's performance based on his or her students' learning…

Recently, interest in test subscore reporting for diagnosis purposes has been growing rapidly. The two simulation studies here examined factors (sample size, number of subscales, correlation between subscales, and three factors affecting subscore reliability: number of items per subscale, item parameter distribution, and data generating model)…

This paper reports on a study of collaborative group work in mathematics. Although collaborative group work is known as one of the important approaches in education, it is still uncertain how group thinking can be measured in various learning contexts. We used the Group Thinking Measure (GTM) test developed by [Wegerif, R., T. Fujita, J. Doney, J.…

This study investigated teacher evaluation practices used in Indiana as the state was implementing a mandated teacher evaluation system (Public Law 90) and early reporting of subsequent teacher effectiveness results by the Indiana Department of Education. The study surveyed public school administrators: (a) superintendents, (b) special education…

In "Houston Federation of Teachers (Plaintiff) v. Houston Independent School District (Defendant)," plaintiffs contested how teachers were being evaluated using a value-added model (VAM) as part of the districts' teacher accountability system. The VAM at issue was the Education Value-Added Assessment System (EVAAS), with potential…