Kirkpatrick's highly popular model of training evaluation criteria proposed four ascending, causally related, and positively intercorrelated levels: reactions, learning, behavior, and results. This article examines the validity of the three problematic assumptions of the model, the frequency of each level in published evaluation studies,…

Applied latent growth curve methodology to study of patterns of change in client resistance during parent training therapy of 68 mothers of children with confirmed conduct problems. Pretherapy maternal characteristics of inept discipline and antisocial behavior predicted chronically high levels of resistance. Lack of negative curvature of…

Drawn by a vision of solving performance problems in a systematic, systemic and results-based approach, training professionals are turning to human performance technology (HPT). However, many who try to implement HPT find themselves struggling to measure the improvements their interventions are designed to achieve. Ford notes that these…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

This chapter discusses current methods of formative evaluation and suggests that these methods themselves need to be subjected to more critical research and evaluation in order to provide them with a more scientific base. Topics addressed include problems and methods associated with data gathering, evaluation designs, number of subjects available,…

The movement away from strictly conventional evaluation practices and toward new and more responsive models of inquiry seems inescapable when one ponders the future of evaluation. A more activist-oriented and more stakeholder-oriented model of evaluation seems to be the future of the field. (SLD)

A study examined the relationship of the respondent and averaged associate ratings on the Listening Practices Feedback Report (LPFR). As part of LPFR listening training sessions, LPFR respondent and associate(s) scores were gathered from several major companies and organizations. Each subject completed an LPFR on his/her own listening behavior and…

The purpose of this paper is to discuss the reasons for resistance to evaluation and the factors that affect adoption of new procedures, while focusing on a model for guiding the planning of evaluation implementation strategies. The process of adoption of an innovation occurs in three stages: orientation, where the user identifies benefits;…

This document provides some guidance to those who are exploring the connections between service-learning and evaluation. Categories are defined in the document by highlighting the following seven questions: (1) What do I need to know about the important issues involved in evaluating my service-learning program? (2) Do you have a model of…

Reviews the state of the art in performance measures and assessment processes in program evaluation before the passage of the Government Performance and Results Act (GPRA), and discusses difficulties in fitting these practices into the GPRA format. Presents a simple logic model for evaluating research programs. (SLD)

This report defines school refusal behavior as the refusal to attend school or difficulties going to school or remaining in school for the entire day, and sees school refusal as a significant problem that may occur in 8% of all school-aged children. It discusses difficulties of previous classification and assessment strategies for students who…

Using architectural design as a model, the article discusses the process of evaluation design. Like the architect, the evaluator faces a problem of finding forms that best fit a partially defined set of contextual demands. The context is the set of all factors which made demands upon the final design form. Like the architect, the evaluator's…

A short history of program theory in evaluation is reviewed. Two related problems in program evaluation are discussed and illustrated: (1) how to specify in measurable terms the consensus of theories and values that guides the program; and (2) how to construct a theoretical framework that specifies the use of these measurements. (Author/JAZ)

Discusses the management and evaluation of diversity in the workforce and emphasizes the need to link diversity issues with organizational goals and performance needs. Differences between a "quick fix" and systematic action are examined; distinctions between a program and a process are explained; and measuring results of diversity…