Proposes a method for synthesizing findings within mixed-method program evaluations. The proposed method uses a set of criteria and analytic techniques to assess the worth of each data source or type and to establish what each says about program effect. Once data are on a common scale, simple mathematics allows synthesis across data sources or…

Describes the number needed to treat (NNT) as an indicator of a program's efficacy. L'Abbe plots compare several programs in terms of the event rates that constitute the NNTs. Explains how an evaluator may extend the NNT concept by calculating and plotting event rates on a continuous ordinal basis. (SLD)

The role of the evaluator in insuring utilization and quality of evaluation results is discussed. Topics covered include a utilization-focused vision of accountability, overcoming staff fears of evaluation, eliciting the right information from users, situational responsiveness, and advocacy. (TJH)

A modification of Donald Kirkpatrick's model suggests use of a training-impact tree to identify variables that could establish links between training and organizational values. Steps include identifying organizational values and practices; identifying skills, knowledge, and attitudes; defining scope and purpose of evaluation; gathering data; and…

Presents, in light-hearted way, a few rules of evaluation practice wisdom that, if followed, would result in more rigorous and useful evaluations of human services programs. Although none of the ideas is totally original, it is suggested that as a group they provide handy checklist for practitioners who are developing or assessing evaluation…

A task force was set up to develop a system of evaluating community-based, nonprofit organizations that were members of the Rockford, Illinois, United Way. The task force experimented with participatory evaluation, which resulted in an action plan for the groups. (JOW)

An experienced volunteer discusses the importance of volunteer evaluation and encourages volunteer administrators to consider their policy of volunteer evaluations from a volunteer's point of view. (JOW)

Identifies five themes that illustrate different aspects of the process of diffusing democratic deliberation into more widespread use: (1) appreciation; (2) addition; (3) apprehension; (4) application; and (5) adaptation. These themes give guidance concerning evaluation practice and the role of evaluation in society. (Author/SLD)

Joint protection, a self-management technique taught to people with rheumatoid arthritis, was used in a group education program. A crossover trial (N=35) was conducted. No significant changes in measures of pain, functional disability, grip strength, self-efficacy or helplessness occurred post-education, although this may have been due to the…

Targeting Outcomes of Programs is a model used to assess volunteer program inputs (resources, activities, participation), outcomes (reactions, changes in knowledge, skills, opinions, aspirations), and impact (practice changes and societal, economic, and environmental impacts). (SK)

Describes the development of program theory evaluation and the various versions of program theory evaluation currently in use. Discusses some of the differences between theory and evaluation practice. Program theory evaluation consists of an explicit theory or model of how a program causes outcomes and an evaluation that is at least partially…

Provides guidance about which links in program theory to study and which theories to use. In choosing the links to study, the first criterion is to choose the links that are most critical to the success of the program. The second criterion is the degree of uncertainty about the linkage. (SLD)

Discusses the potential that program theory evaluation has to provide knowledge about the parts of a program that should be retained and the parts that can be changed or should be abandoned. Considers why program theory evaluation may be able to give some guidance about how a program should be changed to function in a new and different…

Summarizes interesting aspects of the preceding chapters and the issues and concerns raised related to program theory evaluation. Suggests that evaluators may be fighting a losing battle in their efforts to shore up weak programs through the introduction of program theory evaluation, asserting that the development of strong program theory should…

Studied the convergence of evaluator and non-evaluator perspectives about collaborative evaluation. Results based on work of 67 pairs of evaluators and program practitioners show that, generally, program practitioners were more conservative in their opinions. Many differences in the two perspectives are noted. (SLD)