The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher performance. This article studies the year-to-year variability in value-added measures for elementary and middle school mathematics teachers from five large…

The misuse of evaluation is discussed. Boundaries of misutilization are not well understood, and distinctions between misutilization and non-use or abuse are not clear. In general, the responsibility for evaluation misuse is with the user, while the responsibility for misevaluation is with the evaluator. A distinction is also needed between…

Research review on classification and counting of deaths reveals little hard evidence supporting claims that suicides are seriously underreported in United States. Literature suggests that underreporting is counterbalanced by overcounting. Estimates maximum likely net undercount, taking compensating overcounts into account, to be under 10%…

The advantage of trainer certification is that it assures employers that a trainer will perform to an agreed-upon standard. However, instructor certifications address only the most straightforward piece of training. Certifying complex parts of the job would require assessment and observation that would be difficult to administer. (JOW)

To validate a measure of a construct is to validate a theory: The process includes theory specification, theory elaboration, choice of methods, choice of research design, reliance on necessary auxiliary theories, and empirical observation. Evaluating the success of the process is likely to be enhanced through quantification. To date, scientists…

This paper is a polemical discussion of assessment in teacher education. Working from the proposition that assessment serves a number of important purposes for a range of stakeholders (students, employers, quality assurance agencies, government), it argues that there is considerable potential for conflict between the different purposes. In an age…

On a general level, the objective of diagnostic classifications models (DCMs) lies in a classification of individuals regarding multiple latent skills. In this article, the authors show that this objective can be achieved by multidimensional adaptive testing (MAT) as well. The authors discuss whether or not the restricted applicability of DCMs can…

The purpose of this article is to extend the discussion of issues currently being debated on the need for more rigorous program evaluation in educational and other sectors of research, to the field of international development evaluation, reviewing the different approaches which can be adopted to rigorous evaluation methodology and their…

Course evaluation is integral to medical education. We discuss (1) distinctive features of medical education that impact on course evaluation, (2) a framework for course evaluations, (3) details that shape the evaluation process, (4) key measurement issues important to data gathering and interpretation, and (5) opportunities for expanding the…

Authentic assessment is a growing alternative to conventional testing. This research-to-practice article describes a framework for implementing authentic assessment. The R-E-A-L framework shows how roles, equipment, assessment tools, and location can be incorporated into early childhood practices.

While legislative oversight offices, like many evaluation and policy analysis units, face substantial challenges in promoting use of their work by policymakers, they often have not taken steps to overcome these challenges by adopting the strategies suggested by the evaluation literature. Although the offices seek utilization, they have not fully…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

The UK educational assessment landscape is changing, characterised by attempts to create more flexible pathways through learning. This has led to attempts to formalise the comparative relationships between different general and vocational qualifications. The National Qualifications Framework (NQF), the Framework for Achievement and the Framework…

Increasingly, institutions of higher education are required to evaluate student progress and programme effectiveness through implementation of performance assessment practices. Faculty members frequently resist performance assessment because of concerns that assessment activities will increase workloads, reduce time for scholarly activities,…

Some questions about the relationship between program evaluation and forecasting are raised. Contrasting the two fields in terms of mind-set, purpose, problems, advantages, and use shows that although their modes of inquiry are indeed very different in many ways, there is interdependence between the two in several areas. (Author/JAZ)