Over the past 7 years, the Oral History Project Team has conducted interviews with individuals who have made signal contributions to evaluation theory and practice, tracing their professional development and contextualizing their work within the social and political climates of the time. By capturing the professional evolution of those who have…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

The purpose of this methodological study is to explore how well a process called "concept mapping" (Trochim, 1989) can articulate the theory which underlies a social program. Articulation of a program's theory is a key step in completing a sound theory based evaluation (Weiss, 1997a). In this study, concept mapping is used to…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

An evaluation system was designed and implemented by a faculty support department to measure the value, identify gaps, and improve the quality of their training at a midsize community college. The Targeted Evaluation Process (Combs & Falletta, 2000) was selected as the evaluation framework because of its applicability to training and nontraining…

New York's Cornell University spends millions of dollars and thousands of staff and volunteer hours to produce more than 1,400 events around the world each year. That's one event every six hours. Is it worth it? Do the 40,000 alumni, parents, and friends who attend feel closer to Cornell after these events? Do they disengage because Cornell didn't…

In this article, the characteristics of five test review models are described. The five models are the US review system at the Buros Center for Testing, the German Test Review System of the Committee on Tests, the Brazilian System for the Evaluation of Psychological Tests, the European EFPA Review Model, and the Dutch COTAN Evaluation System for…

The quality of classrooms serving students with emotional and behavioral disabilities (EBD) is a continuing concern because of its influence on students' educational outcomes. Program evaluation of classrooms for students with EBD has been a recommended practice for many years since Grosenick, George, and George (1987) conducted their…

The Race to the Top Assessment program was authorized as part of the American Recovery and Reinvestment Act of 2009 (ARRA). In September 2010, the U.S. Department of Education (Department) awarded competitive, four-year grants to two consortia of states, the Partnership for Assessment of Readiness for College and Careers (PARCC) and the Smarter…

The government of Ireland, like many European countries, is currently under severe pressure from external forces to grow the economy. One possible way to maintain and grow its economy is through the production of a highly educated and globally competitive workforce. In an effort to develop such a workforce, the government, through the Department…

Environmental education organizations can do more to either institute evaluation or improve the quality of their evaluation. In an effort to help evaluators bridge the gap between the potential for high quality evaluation systems to improve environmental education, and the low level of evaluation in actual practice, we reviewed recent…

Schools are held more responsible for evaluating, quality assuring and improving their student assessments. Teachers' lack of understanding of new, competence-based assessments as well as the lack of key stakeholders' involvement, hamper effective and efficient self-evaluations by teachers of innovative, competence-based assessments (CBAs). While…

Plans for curriculum or pedagogical innovation often lead to little change in practice. Many innovations successful in their early stages fail later, with little post-innovation analysis to understand why. In Scotland, in 2001, the Scottish Executive Education Department initiated the Assessment is for Learning (AifL) programme. Recognising…

The author is increasingly sensitive to the Venn diagram of overlapping expertise in which program evaluation intersects a content area such as public health, urban education, or--in the case of Katherine Hay--international development. Many evaluators practice in these areas of overlap, experts in the evaluation of a specific domain. Given her…

This study investigated faculty development program assessment practices through one-on-one interviews with 20 faculty developers in public and private colleges and universities in a state in the Upper Midwest. Findings from this study indicated program assessment continues to be a routine practice predominantly focused on superficial measures.…