The Project on Secondary Analysis at Northwestern University is funded to (1) test and develop new methods of evaluating educational programs, and (2) reanalyze existing evaluation data to assure that estimates of program effects are as unbiased and unequivocal as possible. This paper examines the topic of secondary analysis and describes some of…

Some of the methodological problems in analyzing and reporting qualitative data are addressed, and some solutions based on recent experiences in conducting several qualitative studies are proposed. The following are some guidelines for implementing an intuitive approach to analyzing and reporting qualitative data: (1) use a team of evaluators; (2)…

Introduces this special issue on multilevel models. The first two articles examine the application of multilevel modeling (MLM) in the evaluation of large-scale multi-site interventions. The next two articles focus on developmental and longitudinal data analysis, and the last two describe innovative applications of MLM. (SLD)

This study aimed to investigate the transformational impact of introducing significant new learning technology in an Australian university over the time period 2007-2009. The exploration of this transformation is grounded in a social-ecological systems approach to the management of technology enhanced learning environments in the face of constant…

Coalitions have key roles in helping their communities accomplish the following: (1) Track the level of literacy in the community; (2) Use that information to help identify what, and how much, literacy assistance is needed; (3) Assess the extent to which community literacy programs are meeting the need, including how well existing literacy…

In order to assess how completely a Small Learning Community (SLC) and/or Career Academy is implemented in any given site, and to connect the degree of implementation with the amount of improvement in student performance, two kinds of information are needed. The first is information on the quality of implementation, which can be collected by…

This qualitative study explored the impact of teacher collaboration in a professional learning communities (PLC) school on teacher self-efficacy. Through the collection and analysis of personal interview data from 20 teachers in a large, suburban Midwestern high school, the impact of structured teacher collaboration was evaluated for its impact on…

This article evaluates three general types of computer-assisted approaches to multicriteria decision problems in which criteria are attributes as opposed to objectives. Several programs specifically designed for multiattribute problems, as well as spreadsheets and decision-free software, are discussed. (Author/BS)

Problems related to the evaluation of rehabilitation agencies and rehabilitation education programs are reviewed. Questioned are the assumptions that even shoddy evaluation is better than nothing and that the consumer is one of the best sources of evaluation data. Corruption of data and selective or distorted reporting of results are discussed.…

Suggests that performance measurement data already being collected could become more useful, at low additional cost, by further analyzing the relationships among the measures, especially across time. Using logic models and analyzing variability among program delivery units could provide evidence for hypothesized connections among delivery,…

Naval aviation needs a unified standard for job-task analyses and data collection. Such a standard would facilitate consolidation of data across aviation platforms and permit evaluation of training content across phases of the training continuum. It would also make possible the construction of a training transfer evaluation system. The Navy cannot…

The purpose of this study was to evaluate a fit for life program at a university and to use the findings from an extensive literature review, consultations with formative and summative committees, and data collection to develop an interdisciplinary, physically active lifestyle (IPAL) course model. To address the 5 research questions examined in…

The study is an evaluation of an English as a Second Language (ESL) program at a southeastern technical college. Thousands of adults who enroll in ESL programs are individuals who appear to be intelligent. They have worked diligently for a year or more to learn to speak, read, write, listen and improve English comprehension skills. However, some…

As technology becomes increasingly integrated into K-12 education, the use of data is growing in volume and complexity, resulting in a paradox of information overload for educators. While administrators and teachers have access to more data than ever before, they are only just beginning to understand the impact of data on program improvement. In a…

Analysing Training Evaluation of the Worth of Training (TEOT) data collected in Successive Intervals Scaling procedures makes possible a more realistic assessment of input TEOT data, and enables training executives to improve their decision making at very low cost. (SA)