Many quality assurance systems rely on high-stakes assessment for course certification. Such methods are not as objective as they might appear; they can have detrimental effects on student motivation and may lack relevance to the needs of degree courses increasingly oriented to vocational utility. "Alternative assessment" methods can…

The purpose of this article is to describe and analyze the edTPA, a performance assessment created by the Stanford Center for Assessment, Learning, and Equity (SCALE) and administered by Pearson, Inc., to assess the professional readiness of student teachers. We challenge claims made in support of using this assessment, specifically within the…

Principals and teachers do not use large-scale assessment results because the lack of distinct and reliable subtests prevents identifying strengths and weaknesses of students and instruction, the results arrive too late to be used, and principals and teachers need assistance to use the results to improve instruction so as to improve student…

This brief (1) defines indicators, (2) places the concept into the context of the various ways indicators can be used in education, (3) explores some specific considerations and concerns that arise in evaluating results, (4) offers a categorization and examples of short-term outcome indicators for school use, and (5) stresses the need for policy…

Using computers to evaluate teachers based on student test scores is more difficult than it seems. Value-added modeling is a genuinely serious attempt to grapple with the difficulties. Value-added modeling carries the promise of measuring teacher quality automatically and objectively, and improving school systems at minimal cost. The essence of…

Correlations between self-reported learning gains and direct, longitudinal measures that ostensibly correspond in content area are generally inadequate. This chapter clarifies that self-reported measures of learning are more properly used and interpreted as evidence of students' perceived learning and affective outcomes. In this context, the…

There is an increasing interest in the field of experiential education to move beyond simply documenting the value of experiential education programs and, instead, develop more evidence-based models for experiential education practice (cf., Gass, 2005; Henderson, 2004). Due in part to the diversity of experiential education programs, participants,…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

Although priding itself on high rates of literacy achievement, New Zealand's track record in the last two decades has noticeably declined. Successive New Zealand governments have invested heavily in trying to redress this decline with limited success. Demographic changes in population due to immigration provide a partial explanation, but arguably,…

School improvement is much sought and often claimed. However, it is questionable whether overall achievement in countries such as the USA or England has improved by any significant amount over thirty years. Several school improvement programmes have been claimed as successful, but evaluations, even where they exist, are generally poor: based on…

The five papers in this special issue of the "Journal of Applied Testing Technology" address fundamental issues of validity when tests are modified or accommodations are provided to English Language Learners (ELL) or students with disabilities. Three papers employed differential item functioning (DIF) and factor analysis and found the…

How can indigenous evaluators implement culturally competent models in First Nations communities while ensuring that government grant evaluation requirements are met? Through describing the challenges in one tribal community in the United States, this article will discuss how American Indian/Alaska Native substance abuse prevention programs are…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher…