Proposes an alternative program logic model based on the concepts of learning organizations and systems theory. By redefining time as an evolutionary process, the model provides a space for stakeholders to record changes in program context, interim assessments, and program modifications. (SLD)

Describes the scope of evaluation efforts of the Even Start family literacy program to date, summarizing the evaluation strategies, rationale, intended audience, and findings. Discusses the different lenses offered by evaluation at state and local levels. (SLD)

Suggests an approach to providing practical evaluation training through university-supported, long-term funded evaluation projects. Such projects are managed through a university center that provides assistance to clients in student assessment and program evaluation. Discusses the benefits and challenges of these experiences for students. (SLD)

Discusses the challenges facing evaluators of welfare reform and the ways that multiple methods can be combined to meet these challenges. Describes the studies reported in this issue. (Author/SLD)

This paper reviews the state-of-the-art in program evaluation for substance abuse prevention efforts. Included in this review is a discussion of approaches to process, outcome, and impact evaluation. Evaluation designs are reviewed with attention given to topics such as recruitment and retention of sites and participants, defining interventions,…

Application of evaluability assessment by the Cooperative Extension Service of the Department of Agriculture is reviewed. The effort involved five states with six major programs since 1984. Underlying philosophy and methodological considerations are discussed, and background information is provided on the assessment processes and studies…

Describes a training-evaluation method that assesses whether participants remember what they were supposed to have learned and know how to apply it on the job. (Author)

A technique to estimate variances of weighted estimates in program evaluation is discussed. BRR estimates of variance are constructed from orthogonally weighted subsamples and can provide better estimates from complex samples than can other methods. Use of BRR is illustrated in a government evaluation of a food service program. (SLD)

Changes made in 1981 to the Aid to Families with Dependent Children (AFDC) program under the Omnibus Budget Reconciliation Act were evaluated. Multiple quasi-experimental designs (interrupted time series, non-equivalent comparison groups, and simple pre-post designs) used to address evaluation questions illustrate the issues faced by evaluators in…

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

This evaluation matrix considers three aspects: (1) evaluation focus (purpose/rationale, context, audience); (2) evaluation design (questions, methods, data sources, analysis, reporting); and (3) management (personnel, timeline, costs). Application to six elements (participant, instructor, course, curriculum, program, project) is illustrated. (SK)

Presents a selected bibliography of scholarship in the assessment of writing. Offers 125 items that have appeared in major scholarly publications from 1979-91, organized in 7 categories: large-scale assessment; classroom writing assessment; theory; politics and issues; methods and procedures; program assessment; and networking resources. (SR)

The appropriate delivery of service to people with intellectual disabilities in Victoria (Australia) can be facilitated by General Service Plans (GSPs). This paper provides suggested content for such plans, a protocol for their evaluation, and an assessment of GSPs in Victoria constructed between 1987 and 1990. A large number of GSPs were found to…

A series of surveys in the last 30 years shows little application of Kirkpatrick's 4-level model for training evaluation (reaction, learning, application, benefit) beyond level 1, a finding confirmed in recent responses from 72 of 620 companies surveyed. A mirror of the model, working from level four to one and back, might be more widely adopted.…

Previous research on program implementation is integrated and extended to form a participatory approach to evaluating program implementation. This method focuses on the continuous active involvement of program developers, managers, and staff in the evaluation process. The methodology is applied to an actual program to highlight the steps involved.…