When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

Background: Social experiments frequently exploit data from administrative records. However, most administrative data systems are designed to track earnings or benefit payments among residents within a single state. When an experimental participant moves across state lines, his entries in the data system of his state of origin consist entirely of…

Many inquiries regarding the causal effects of policies or programs are based on research designs where the treatment assignment process is unknown, and thus valid inferences depend on tenuous assumptions about the assignment mechanism. This article draws attention to the importance of understanding the assignment mechanism in policy and program…

This study explores the possibility that any drug prevention program might be considered "evidence-based" given the use of data analysis procedures that optimize the chance of producing statistically significant results by reanalyzing data from a Drug Abuse Resistance Education (DARE) program evaluation. The analysis produced a number of…

Poisson and negative binomial regression methods are used to analyze the monthly time series data to determine the effects of introducing an integrated security management system including closed-circuit television (CCTV), door alarm monitoring, proximity card access, and emergency call boxes to a large privately-owned complex of apartment…

This article describes rates of missing item responses in personal digital assistant (PDA) assessments as compared to paper assessments. Data come from the evaluation of a classroom-based leisure, life skills, and sexuality education program delivered to high school students in Cape Town, South Africa. Analyses show that the paper assessments had…

Examined six published papers using a theory-based evaluation (TBE) approach. Found that authors of the papers did not always make explicit the relation of their data to the theory of the program. Identified some ways in which TBE contributed to the merit of the evaluation. Outlines lessons for the future of TBE. (SLD)

This article presents a discussion of field utilization of staff development activities in the context of three separate training programs. Specifically, classroom implementation of knowledge and skills gained by participants in their training sessions was assessed via the Levels of Use (LoU) interview system. (Author/LMO)

Trends in European practice that relate to qualitative assessment in the evaluation of the impact of research and innovation are discussed and analyzed. To date, European evaluations have been mainly concerned with quality and direct impact with few assessments of medium- or long-term impact. (SLD)

This article evaluates three general types of computer-assisted approaches to multicriteria decision problems in which criteria are attributes as opposed to objectives. Several programs specifically designed for multiattribute problems, as well as spreadsheets and decision-free software, are discussed. (Author/BS)

When procedures for developing recommendations are integrated into evaluation methods, it is easier to produce useful recommendations for program improvement. (RB)

Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

The methodology and design of the process evaluation system of the Pawtucket Heart Health Program (an 11-year project for changing/documenting change in cardiovascular disease risk status of a northeastern city's residents) are described. Examples of the system's use are provided. The maintenance of such a system without substantial evaluation…

Ratings of evaluation consultant and evaluation report were influenced by use of jargon and data but were generally unrelated to whether they were read by a lay or professional audiences. In contrast, extent of agreement with recommendations were related to audience type and rarely related to the style of the report. (Author/GK)

Using data from a sales campaign for the Arizona State lottery, a multiplist strategy of program evaluation is analyzed. Several complementary designs are used within the strategy to help remove threats to internal validity associated with the nonequivalent control group design. (SLD)