The purpose of this methodological study is to explore how well a process called "concept mapping" (Trochim, 1989) can articulate the theory which underlies a social program. Articulation of a program's theory is a key step in completing a sound theory based evaluation (Weiss, 1997a). In this study, concept mapping is used to…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to select a statistical technique that is appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on classifying a study,…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to determine a sampling method that is appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on why and when to sample,…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to develop an experimental design appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on the characteristics of a good…

The Bayesian inferential process is modified for use in an aggregate meta-analytic evaluation. Compared with the average effect size meta-analytic approach, the Bayesian approach was more sensitive, more consistent and more powerful. This approach is recommended when primary data are not available and when all evaluations involve comparisons of…

Use of analysis of covariance or multiple regression can lead to Type I errors in pretest-posttest nonequivalent control group designs. Analysis of the interaction term of a repeated model analysis of variance was shown to help identify areas of significant change. The standardized difference score, effect size, suggested meaningful differences.…

Study report of some evidence on the verification of participant evaluation. Results suggest that the participants' evaluation of adult education programs could be an effective tool for the development and refinement of future programs. (Author)

Statistical identification of employees with unusual sick leave patterns can result in false-positive identifications. A computer simulation model was used to evaluate alternate methods of unusual sick leave detection for the New York State Department of Health. Results were used to refine identification parameters and modify supervisory…

Northampton County Area Community College (Pennsylvania) studied changes in student writing ability using a research paradigm described in the ERIC Clearinghouse for Junior Colleges' fifth topical paper (ED 030 422). Students in seven English classes were randomly assigned to write on one of two topics at the beginning of the semester, and asked…

A Human Relations Training Program conducted with an experimental group of 150 educators from the Upper Cumberland Region in Tennessee is evaluated in this document. In an effort to assess the effects of the program, internal and external criteria, and matched control groups were utilized. The Personal Orientation Inventory, F Scale, Semantic…

This manual is a first effort to begin to identify, describe, and develop procedures for assessing various aspects of digital reference service. Its overall purpose is to improve the quality of digital reference services and assist librarians to design and implement better digital reference services. More specifically, its aim is to: assist…

A series of methods and techniques for measuring educational wastage are presented step-by-step. Some considerations on the conceptual framework of this problem in statistical terms are presented, and tentative definitions for certain terms are also given. Examples taken from published material and recent surveys showing the extent of grade…

Covered in the assessment are 128 school systems having contracts for Consumer and Homemaking Education with the Division of Vocational and Technical Education (Illinois) and meeting at least one of four criteria for qualifying as disadvantaged. The evaluation followed the guidelines of the Information Based Evaluation Model (IBE) which addresses…

This guide is intended to assist states and service delivery areas (SDAs) in addressing the new oversight responsibilities and opportunities stipulated by the Job Training Partnership Act (JTPA) with respect to management information system (MIS) issues in evaluating JTPA programs. The first chapter discusses the general requirements of a JTPA MIS…