Although dealing broadly with issues involving program evaluation, this paper is especially concerned with large-scale evaluations of federally funded education programs that are national in scope and, to some extent at least, compensatory in nature. The paper concentrates on a few basic problem areas that seem inherent in the concept of…

This document discusses an evaluation of the second year of a bilingual program in a large Eastern city funded by Title VII of the Elementary and Secondary Education Act. Like those in a number of other localities, the Spanish-English program described here developed from earlier "English as a Second Language" project. The evaluation was…

A detailed and critical analysis of the evaluation of the Follow Through program is presented. The history, critical decisions, and politics of the evaluation are examined. (JKS)

Potential methods are explored for removing or otherwise controlling random measurement error, assessment artifacts, irrelevant variation in outcome measures, and confounding sources of covariation in a structural equations model. Using examples with measures of quality of life and functioning, the authors consider these methods for field…

In the research paper considered, Stahl and Miller compare the effectiveness of whole language/language experience programs versus basal reader approaches. The article is criticized for misrepresenting concepts related to emergent literacy and inadequately defining whole language, the lack of equivalence between the two nonbasal approaches, and…

Considers the competing demands placed on evaluators in relation to the service (characteristics of the intervention), the sample (people participating), and methodology or research design. Explores compromises that may be required between scientific ideals and real-world limitations, and assesses implications for obtaining meaningful results in…

This commentary on a previous article that demonstrates three ways of analyzing qualitative interview data (content, cultural models, and narrative analyses), discusses the need for greater articulation of the complexities of interpretation and a greater emphasis on verification procedures in early intervention qualitative research. (CR)

A quality control review of Connecticut's Sustained Effects studies was undertaken by the Chapter 1 Evaluation Technical Assistance Center (TAC) operated by RMC Research Corporation. Nineteen Connecticut school districts had selected from among four basic evaluation designs in implementing the Chapter 1 Sustained Effects requirement during 1982 to…

The question of how standardized tests can be better developed to improve educational program evaluation is probed in this paper. After the first section's brief introduction, section 2 explores the thesis that tests developed in terms of selection and inference may not serve current social functions of educational testing. To clarify this thesis,…

In an effort to review the effectiveness and the impact of the Office of Institutional Research (OIR) at El Paso Community College (EPCC) and to identify and report any significant problems with the quality of service being provided to the college president and other key policy and decision makers, an evaluation plan and survey test instrument…

The Criminal Justice Initiative (CJI) was conducted in Washington, D.C. from fiscal year 1984 through fiscal year 1986 to relieve overcrowded prison conditions by reducing the recidivism rate. Objectives of the project included hiring additional prison staff to provide security and increase prisoner processing, expanding the education program, and…

This paper discusses the theoretical scope and practical applicability of generalizability (G) theory through the principle of symmetry. Major ideas are summarized and factors hindering applications of G theory in research conducted in French-speaking Europe are presented. The principle of symmetry affirms that any factor of a design can be…

After a brief introduction indicating the value of the first Follow Through evaluation, this document offers ideas about how a new wave of Follow Through approaches should be evaluated. The discussion is based on the premise that the form of an evaluation must be derived from the questions for which answers are sought, the audience(s) to whom the…

Two reviews of NIE's study of compensatory education are provided in this document. The conclusions of the first reviewer (House) are that: (1) the study is valid because it meets the standards for the evaluation of a public program; and (2) the compensatory programs, especially Title I, are very good. Other conclusions are that the funds'…

This study is about the impact on students and their families when students used computers in a "summer camp" setting and when computers were introduced into the homes of students who normally could not afford to buy them. The computer camp project involved minority group students 8 to 10 years of age, in 2-hour sessions, 5 days a week…