Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Despite the desire of employers to hire those with the critical-thinking and communication skills a general education (GE) program can offer, the value of GE programs is often questioned due to concerns about four-year graduation rates, perceived low immediate economic payoff, and a dearth of evidence to support their efficacy. This article…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

The article grounds the structure of the external evaluation of colleges at the level of the non-university higher education sector, and it reveals the problems met in this process as well as possibilities for their solution: the phenomenon of the external evaluation of colleges is discussed and its concept is presented; the external evaluation…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Student success is at the heart of both institutional effectiveness and the community college mission, yet measuring such success at community colleges is problematic. This article highlights three efforts to grapple with this problem--a multistate work group of system- and state-level policymakers to create an improved set of student success…

This study examines two community college instructional support programs to explore the effectiveness of an evaluation model--responsive evaluation theory--that may ease the tensions between a concern over programs' processes and reporting requirements for program outcomes. The study uses a comparative qualitative case study design and applies…

New testing theories, concepts, and psychometric methods (e.g., item response theory, test equating, and item bank) developed during the past several decades have many advantages over previous theories and methods. In spite of their introduction to the field, they have not been fully accepted by physical educators. Further, the manner in which…

For better or for worse, the assessment of research quality is one of the primary drivers of the behaviour of the academic community with all sorts of potential for distorting that behaviour. So, if you are going to assess research quality, how do you do it? This article explores some of the problems and possibilities, with particular reference to…

This article chronicles the evolution of a large research extensive institution's General Education writing assessment efforts from an initial summative focus to a formative, improvement focus. The methods of assessment, which changed as the assessment purpose evolved, are described. As more data were collected, the measurement tool was…

A central commitment for professional development schools (PDSs) is to link preservice teacher preparation and in-service teacher professional development with improved learning outcomes for pupils. PDSs are expected to improve student achievement in two primary ways: (1) by enriching and intensifying the learning environment through professional…

This paper describes three multigrade school reforms in Latin America: (1) Colombia's "Escuela Nueva", (2) Guatemala's "Nueva Escuela Unitaria", and (3) Chile's MECE-Rural. Each reform endowed primary teachers and students with special training and instructional materials, and encouraged new kinds of instruction in rural…

This support document accompanies the NCVER report, "A Review of Indigenous Employment Programs," hereafter the "Report" [ED499667]. It contains explanatory notes on evaluation methodology, plus additional details on developments in labor market assistance and reviews of the literature relating to the evaluation of such…

Describes and illustrates techniques for assessing productivity in colleges and universities; defines cost analysis and discusses specific techniques of cost-benefit and cost-effectiveness analysis; and discusses related issues in higher education. Use of these techniques is illustrated by a Worcester Polytechnic Institute (Massachusetts) program…

This final report describes a pilot program for the simultaneous appraisal and description of concurrent television newsfilm from the holdings (dating from 1955 to 1972) of three Madison, Wisconsin television stations. The sections of the report are: (1) Project Background and History; (2) Problems of Estimating; (3) Evaluation of the Physical…