Selection bias pervades the evaluation of supplemental instruction (SI) in non-experimental settings. This brief note provides a formal framework to understand this issue. The objective is to contribute to the accumulation of credible evidence on the impact of SI.

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

A year-long case study of the effects of an educational and vocational rehabilitation program in a youth training center was discussed in terms of fourteen issues which might threaten the validity of an evaluation or research project. This correctional institution housed women aged 14 to 21 who were long-term wards of the state, held on remand, or…

Notes that, very early in program planning, budgets are estimated for major program components, including evaluation. Proposes heuristic for establishing reasonable evaluation estimates in initial planning. Describes logical sources of information from which to construct such a heuristic. Recommends that, for typical programs and projects, initial…

Uses a control group study to compare the effectiveness of contingency management training and communication skills training for training parents to manage children with conduct disorders. Concludes that more subjects in the contingency management group met a criterion of clinical success than in either the communication skills or the control…

A rationale is presented for the systematic evaluation of gifted/talented education programs, citing the consequences of failure to carry out such evaluation. Historically, evaluation of gifted programs was not emphasized, as the evaluation process involved experimental designs, control groups, and parametric statistics which could only be…

Elaborates on the article "Synthesis of Research on the Effectiveness of Intellectual Skills Programs: Snake-Oil Remedies or Miracle Cures?" by Sternberg and Bhana. Encourages the development of a theory that could provide a guide to the infusion of thinking instruction into any area of inquiry. (IW)

The National Survey of Student Engagement (NSSE) documents dimensions of quality in undergraduate education and provides information and assistance to colleges, universities, and other organizations to improve student learning. Its primary activity is annually surveying college students to assess the extent to which they engage in educational…

The effectiveness of an Education Consolidation Improvement Act Chapter 1 program was studied in a large urban school district. A common problem in evaluating remedial programs is that pretest/posttest achievement gains often indicate the effects of the entire curriculum, rather than those specific to the remedial class. In this district, over…

Reviews the research on the effectiveness of five thinking skills training programs: Instrumental Enrichment, Philosophy for Children, Structure-of-Intellect (SOI), Problem Solving and Comprehension: A Short Course in Analytical Reasoning, and Odyssey. Compares and contrasts the content of each program and describes the relative lack of adequate…

This document presents a brief overview of conflict resolution in school settings and defines conflict resolution as: (1) a constructive approach to interpersonal and intergroup conflicts that helps people with opposing positions work together to arrive at mutually acceptable compromise solutions; and (2) as the body of knowledge and practice…

Maintains that empirical curriculum development (evaluating a curriculum as one develops it) can be a useful tool for drug abuse prevention efforts. Presents a model of a systemic process of empirical development that considers variables such as manipulation checks, interest, belief changes and perceived helplessness. Discusses research…

Brief case studies of three projects are presented to illustrate the steps which open "Wonderful Programs" to evaluation research. The evaluator is provided with the perspective needed to believe the evaluation is worth doing. The project staff is then redirected to the need for a new type of evidence. An ongoing review of the commitment…

Principles of program evaluation research are outlined so that bilingual education program coordinators can conduct methodologically acceptable program evaluations. The three basic principles of evaluation research are: identification of the program participants, definition of the program intervention, and assessment of program effectiveness.…

A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…