This article reflects on key methodological issues emerging from children and young people's involvement in data analysis processes. We outline a pragmatic framework illustrating different approaches to engaging children, using two case studies of children's experiences of participating in data analysis. The article highlights methods of…

This paper describes the process of designing and administering a sufficiently valid and reliable assessment instrument to measure the progress in attainment of adult learners studying numeracy, and discusses some of the inherent difficulties that were involved. The fieldwork took place during 2003-2005 and involved a sample of 34 teachers and 412…

The intent of large-scale assessment systems is to promote student achievement toward specific standards by holding schools accountable for the performance of all students. However, it is difficult to know whether large-scale assessment systems are having this intended effect as they are currently implemented. In this article, the authors examine…

Some questions about the relationship between program evaluation and forecasting are raised. Contrasting the two fields in terms of mind-set, purpose, problems, advantages, and use shows that although their modes of inquiry are indeed very different in many ways, there is interdependence between the two in several areas. (Author/JAZ)

In this collection, evaluation theorists and practitioners consider evaluator role and identity in evaluation theory, practice, and society. The chapters are: (1) "Three Frameworks for Considering Evaluator Role" (Jean A. King and Laurie Stevahn); (2) "Toward Better Understanding of Alternative Evaluator Roles" (Melvin M. Mark); (3) "Making (More)…

Recommends that when repeated-measures Latin-square designs are used to counterbalance treatments across a procedural variable or to reduce the number of treatment combinations given to each participant, effects be analyzed statistically, and that in all uses, researchers consider alternative interpretations of the variance associated with the…

Discusses ethical challenges faced by evaluators, especially those who have gotten into problems while conducting the evaluation. Introduces the other articles in this theme section. (SLD)

Explores why summative, or high-stakes, assessment in higher education is in disarray, and why formative assessment therefore needs attention, along with the nature of curriculum in higher education. (EV)

Notes that, very early in program planning, budgets are estimated for major program components, including evaluation. Proposes heuristic for establishing reasonable evaluation estimates in initial planning. Describes logical sources of information from which to construct such a heuristic. Recommends that, for typical programs and projects, initial…

Presents dialog among David Lester, author of first critical survey of death anxiety measures, developer of scales, and researcher about suicide and fear of death; Donald Templer, Death Anxiety Scale (DAS) creator; and journal editor. Lester and Templer discuss origins, uses, results, limitations, and future of death anxiety scales and research on…

Reflects on an evaluation that aspired to be inclusive but generally failed to provide a backdrop for a discussion of inclusive evaluation. Identifies issues of absence of significant stakeholders, making of values by method, and the limited authority of the evaluation. Shows how easily deliberative intentions are distorted. (SLD)

Challenges the assumption that evaluation should aim for fostering deliberative democracy. A modest effort by an evaluator to contribute to deliberative democracy is defensible, but vigorous political advocacy violates social expectation. (Author/SLD)

Whether there can be professional reasons for turning down an evaluation contract is explored. Considering how evaluations can promote either guild maintenance interests or societal improvement interests illuminates several dilemmas in the proper conduct of evaluation and suggests the need for greater explicit attention to what it means for the…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

Recent decades have witnessed a remarkable rise in the regulation of public services and servants, education being a case in point. External evaluation and inspection has been an important element of this trend. Increasingly, however as the limitations of external surveillance systems have become clear the concept of internal or self-evaluation…