This paper is meant to highlight the occurrence of Simpson's Paradox when using aggregated data obtained from two IEA studies in Israel, while ignoring the effect of a powerful intervening variable in the local context--the ethnicity factor. It will demonstrate faulty conclusions regarding either the absence of relationships between a contextual…

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to…

This study discusses three evaluations completed in a large suburban school district, each of which involved stakeholders purposefully throughout the inquiry process. The reflective case narrative addresses three questions: (1) To what extent or in which parts of the evaluations were stakeholders involved? (2) What actions did the evaluator(s)…

Statewide exit examinations play an important role in discussions on school effectiveness. Referring to educational governance concepts, this paper presumes a relation between varying organizational structures of statewide examinations across states, and heterogeneous effects on school actors. It is assumed that their ability to affect work in…

As a result of the federal No Child Left Behind Act (NCLB) of 2002, the field of education has seen a heavy emphasis on the use of "scientifically based research" for designing and testing the effectiveness of new and existing educational programs. According to NCLB, when addressing basic cause and effect questions scientifically based…

Recent decades have witnessed a remarkable rise in the regulation of public services and servants, education being a case in point. External evaluation and inspection has been an important element of this trend. Increasingly, however as the limitations of external surveillance systems have become clear the concept of internal or self-evaluation…

Seven basic types or styles of profile reports are described in detail. Various attributes of profiles are presented, which are common to many extant profiles. Three sets of warnings are offered about the nature, content, and limitations of profiles in general. (LMO)

England and Wales have experienced a groundswell of dissatisfaction with traditional school examinations, and a corresponding enthusiasm for and interest in the development of alternative forms of assessment, variously called Profiles or Records of Achievement. Difficult issues must be addressed before such records can take the place of formal…

This introduction provides an overview of the eight other articles in the special issue and summarizes the objectivist concept of educational evaluation that the author recognizes as growing from the work of the Center for Research on Educational Accountability and Teacher Evaluation (CREATE). (SLD)

This essay provides some background on, explanation of, and justification of a theoretical framework for all types of evaluation. This framework is used to connect and underpin the approaches of other contributors to this special issue. A core discipline of evaluation is proposed that ties assorted evaluation fields together. (SLD)

Describes two evaluation studies that faced ethical problems because of an atmosphere of promotion and advocacy. One was the evaluation of a teachers' professional-development program, and the other was an evaluation of a federally funded youth sports program. The realization and resolution of ethical conduct must come from within the evaluator.…

The dynamic interplay between internal and external evaluation in formative and summative studies of an intervention program aimed at promoting mathematics, science, and technology education was explored. Results emphasize the need to define the roles of formative and summative evaluation and the contributions of internal and external evaluators…

The evaluation of a science education project for teachers in Durban (South Africa) illustrates some problems inherent in the application of the fourth-generation evaluation approach of Guba and Lincoln. One of the strongest concerns is that full participation by stakeholders may be an unrealistic assumption. (SLD)

Problems associated with evaluating the restructured curriculum and educational system implemented in Kenya in 1985 are reviewed. Most of the problems center around time constraints and the large numbers of students versus the small numbers of teachers and administrators. (SLD)

Marking strategies used in the Danish school system from the compulsory Folkeskole level through higher education are described, with emphasis on "the 13-Scale." Problems, impacts, recent developments, and trends in marking strategies and the communication of their meaning are discussed. (BS)