This guidance is intended for the planning stage of trials -- in particular, trials for which the primary outcome measure being considered is attainment at GCSE (and in particular, GCSE English Language and Mathematics). However, it is generalisable to any other graded qualification or assessment used as an outcome measure, i.e. A-levels. It is…

The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

Major advances in the number, capabilities, and quality of state, national, and transnational databases have opened up new opportunities for evaluators. Both large-scale data sets collected for administrative purposes and those collected by other researchers can provide data for a variety of evaluation-related activities. These include (a)…

This paper provides a reflective account of a consultation process on professional designations for evaluators initiated and coordinated by the Canadian Evaluation Society (CES). Described are: (1) the forces leading CES to generate discussion and debate about professional designations for Canadian evaluators, (2) the process of developing and…

Program evaluation and planning is at the heart of efforts to integrate the domains of practice and research. Traditionally, research and practice have operated in independent spheres with practitioners focused on the implementation of programs that affect individual behavior and researchers focused on the development and testing of theory.…

Multilevel programs--that is, programs with multiple levels of administration, funding, and implementation--present dynamic and challenging environments for the conduct and use of evaluation. The challenges include questions, priorities, audiences, and purposes that vary at each level. This chapter discusses the challenges as well as the…

The authors present an approach for educating future evaluators by connecting evaluation theory and practice, organizational development, and grant making through experiential learning. They position this discussion on the conceptual framework of a newly developed graduate-level evaluation course, Advanced Program Development and Evaluation, which…

Describes the development of the International Development Evaluation Association (IDEAS) and the context in which it will operate. This new wing of the international evaluation architecture has been designed to support development evaluators in tackling professional changes of the new century. (SLD)

The advice of evaluators is useful in the planning of program objectives because the program will eventually be evaluated on the basis of these objectives. This paper provides two tools for the development of program objectives. The "Levels of Program Objectives" method focuses on the intended outcomes of a program. The levels range from the…

In May 1990, the first evaluation seminar in Africa took place in Cote d'Ivoire. It was the first in a series of regional seminars on evaluation planned by the Development Assistance Committee (DAC) of the Organization for Economic Cooperation and Development (OECD). The seminar was jointly presented by the DAC and African Development Bank (ADB).…

Described is a program for training M.A.-level evaluation researchers within an academic department. The topics covered are devising the curriculum, recruiting students, conducting internships, involving the community, and evaluating the program. (Author/RM)

This article describes the on-going evaluation of a pilot program characterized by: (1) cooperation between program managers and evaluators; (2) first-hand knowledge about the implementation of the pilot; and (3) a focus on summative and formative evaluations. Evaluators participated actively in the design of the pilot. (Author/SLD)

The Louisiana Round Table of Program Evaluators was organized in 1980 among educational evaluators from large parish school systems and the State Department of Education to discuss topics of mutual concern. Since its inception the group has been instrumental in the development and implementation of various workshops directed toward the improvement…

The Department of Measurement, Statistics, and Evaluation (EDMS) at the University of Maryland is working to develop Master's degree programs that are oriented around developing assessment professionals for work in applied settings. Two fundamentally different sets of experiences are being developed: (1) assessment development, administration, and…