This study addresses validity issues in evaluation that stem from Ernest R. House's book, "Evaluating With Validity". The authors examine "American Journal of Evaluation" articles from 1980 to 2010 that report the results of policy and program evaluations. The authors classify these evaluations according to House's "major approaches" typology…

From a systems analysis viewpoint, an evaluation system is a subsystem that is superimposed on the educational system to provide information for decisions related to its maintenance and goals. Educational outcomes, viewed as a much broader concept than the traditional view of changes in pupil behavior, represent the starting point for any…

Evaluation is data gathering, analysis, and interpretation that leads to decisions about practices and goals. Relatively simple analytical techniques can suffice for many evaluation purposes. Evaluation of inservice education may be viewed as an operating system where input is provided, processes are implemented, and products are generated. When…

The ninth part of a 10-part series, this report was compiled by the Educational Development Center at Wilkes College. The series deals with various aspects of the treatment of delinquents and is intended as a summary of research findings in each of the areas treated. Each report was prepared by a scholar-practitioner and is presented in a way that…

Different approaches to evaluation are described: systems analysis, behavioral objectives, professional review, and case study. For an evaluation system to operate, it must be perceived as being fair; the legitimacy of evaluation is dependent on the issue of fairness. (MLW)

As our society moves increasingly from an era of affluence to one of scarcity, the evaluation and assessment of publicly supported services will become even more crucial and necessary to ensure that public resources are being expended in the most effective manner. Evaluation of library service effectiveness is defined in this paper in terms of…

Education is too complex, multidimensional, and poorly understood to lend itself to a single cost/effectiveness criterion. Rather, analysts in the educational field seek to rank alternatives by their effectiveness, report separately on the cost implications, and leave the tradeoffs to the decisionmaker's judgment. In this context, a program is any…

This manual was conceived as a reference guide for Illinois' 18 library systems to use in their long-range planning and evaluation program. Section 1 of the manual explains the planning model: Context Input Process Product (CIPP). CIPP was selected as a coherent adaptation and modification of many previous planning and design methods: systems…

An orientation to management information systems (MIS) is offered which presents information about MIS in the context of public education and suggests some considerations that should be taken into account in designing and operating such systems. MIS is defined as a set of operating procedures that act as a control system to automatically provide…

This paper presents a model for continuous, systematic evaluation of ongoing programs and specifies data needed for decisionmaking in the areas of program adoption, curtailment, or expansion. These data give the decisionmaker the necessary information for program planning in today's sophisticated educational environment. (Author/RA)

Educational personnel having major responsibilities for research and development were invited to attend three one-week institutes to receive training in the use of selected management tools. instructional topics such as systems and management analysis, and definitive studies of management information systems (MIS), program planning budgetary…

The least understood of complex systems is that which produces educated people. Superficially, many key elements of a manufacturing organization are part of the system: a product, product tolerance limits, methods for assessing product deviation, and a feed-back system for making compensatory adjustments. In layman's terms these elements are:…

This paper explores the fault-tree analysis approach to isolating failure modes within a system. Fault tree investigates potentially undesirable events and then looks for failures in sequence that would lead to their occurring. Relationships among these events are symbolized by AND or OR logic gates, AND used when single events must coexist to…

The purpose of this article is to demonstrate the capabilities and limitations of systems analysis as applied to the development of a program evaluation plan. A brief review of selected concepts in evaluation theory (Lee J. Cronbach; Michael Scriven; Robert Stake; Daniel Stufflebeam), a description of general systems theory, the development of a…