This study examines two community college instructional support programs to explore the effectiveness of an evaluation model--responsive evaluation theory--that may ease the tensions between a concern over programs' processes and reporting requirements for program outcomes. The study uses a comparative qualitative case study design and applies…

Studied the nature of barriers to the implementation of external program evaluation through interviews with 18 staff members of a university outreach program. Findings reinforce the importance of a trusting relationship to avoid barriers to evaluation implementation. (SLD)

The techniques of program evaluation parallel the historian's methods, which usually consist of mining both qualitative and quantitative sources. Test scores, questionnaires, and unobtrusive measures provide good quantitative data, whereas interviews supply important qualitative information. Researcher involvement in the project being assessed can…

Anecdotal evidence from interviews with some program managers gives evidence that unintended negative consequences of evaluations are more than a theoretical concern; they are a real problem deserving an evaluator's attention and energy. Negative consequences usually include: (1) wasted resources; (2) demotivation; and (3) program destruction and…

The impact of a newly instituted prime vendor (wholesaler) pharmaceutical system at Veterans Affairs (VA) hospitals was studied at 33 VA centers and 32 matched comparison hospitals. Results indicate satisfaction with the new system and illustrate the solutions to some interesting evaluation problems. (SLD)

Background: Coordinated school health programs (CSHP) frequently struggle with how to adequately evaluate implementation. The CSHP framework provides flexibility in how it is implemented; however, this flexibility makes it a challenge to effectively evaluate. Portfolios have been used as a technique for evaluating progress and achievement. This…

Issues in the ongoing evaluation of an innovative curriculum in an academic setting are discussed. The program provides instruction in computer literacy to a physically challenged clientele and to professionals from local service agencies who have disabilities. Data have been collected through survey questionnaires principally composed of Likert…

Evaluators usually assume that the data they receive are valid, or at least, that the data reflect that which is being evaluated. In a recent evaluation in a large southern school district, evaluators compared their raw interview notes with interview notes edited by the teachers interviewed or project staff. The program evaluated was Project SEED,…

A beverage-server intervention project at two West Coast Navy bases that attempted to reduce levels of alcoholic intoxication via policy changes and server training is described. Data obtained via interviews and structured observations of 1,511 club customers indicate methodological bias and self-selection effects. Bias adjustments were performed…

Issues emerging from a collaborative evaluation of an interactive video teaching trial conducted in Rockhampton (Queensland, Australia) are reported. The trial aimed at providing an assessment of the feasibility and potential of interactive video technology for teaching and learning in a diverse area of Australia with a number of small, widely…