This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

This support document accompanies the NCVER report, "A Review of Indigenous Employment Programs," hereafter the "Report" [ED499667]. It contains explanatory notes on evaluation methodology, plus additional details on developments in labor market assistance and reviews of the literature relating to the evaluation of such…

With the myriad challenges facing parents in recent years, formal parenting training programs have been developed to address parent needs. However, few studies have been conducted to assess the actual effects of participating in such programs. An attempt to develop a better understanding of how informal parental support networks and formal parent…

The role and methods of an evaluator of program effectiveness are discussed. Responses to questions prepared by academicians were obtained from three evaluation practitioners; an external, independent evaluator; and an internal evaluator with program implementation responsibilities. Practitioners uniformly indicated that internal evaluators were…

Reviews available published rural program evaluation efforts, documents reasons rural community mental health centers have offered for not implementing systematic program evaluation activities, and offers constructive suggestions for overcoming barriers to evaluation. Introduces standard program evaluation strategies. Discusses techniques and aids…

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the second in the kit, provides advice about planning an evaluation--from deciding on the major questions the evaluation is intended to address, through the general approach--and identifying the principal…

Describes the challenges faced by researchers in evaluating a neighborhood revitalization project. Places the challenges in the context of three of the Program Evaluation Standards of the Joint Committee on Standards for Educational Evaluation: Values Identification, Fiscal Responsibility, and Analysis of Quantitative Information. (SLD)

Different dimensions of evaluation utilization and evaluator strategies for stimulating use are discussed, in terms of designing a formal evaluation utilization system. While the need exists to improve the design process, there is no simple formula. Evaluators should see part of their function as creating a repository of knowledge. (SLD)

Studied the nature of barriers to the implementation of external program evaluation through interviews with 18 staff members of a university outreach program. Findings reinforce the importance of a trusting relationship to avoid barriers to evaluation implementation. (SLD)

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

The purpose of this article is to extend the discussion of issues currently being debated on the need for more rigorous program evaluation in educational and other sectors of research, to the field of international development evaluation, reviewing the different approaches which can be adopted to rigorous evaluation methodology and their…

One source of bias, regression artifacts, in program evaluations that use regression discontinuity design is identified, and its importance is discussed. A method is suggested for its correction. Although use of this method does not solve the problem of selection bias, it does improve the reliability of nonexperimental methods. (SLD)

Conducted telephone survey on state efforts to evaluate school programs funded under Drug-Free Schools and Communities Act. Some states reported studies of program implementation and some reported drug- and alcohol-use surveys. Together, these two types of evaluation efforts formed foundation of approach for conducting evaluations under the act.…

The techniques of program evaluation parallel the historian's methods, which usually consist of mining both qualitative and quantitative sources. Test scores, questionnaires, and unobtrusive measures provide good quantitative data, whereas interviews supply important qualitative information. Researcher involvement in the project being assessed can…

The nine articles of this theme issue provide overviews of legislative program evaluation and demonstrate the tensions caused by the conflict between utility and rigor in such evaluations. Legislative evaluation is concerned with evaluation utilization because legislators commission evaluations they expect to use. (SLD)