The Project on Secondary Analysis at Northwestern University is funded to (1) test and develop new methods of evaluating educational programs, and (2) reanalyze existing evaluation data to assure that estimates of program effects are as unbiased and unequivocal as possible. This paper examines the topic of secondary analysis and describes some of…

Some of the methodological problems in analyzing and reporting qualitative data are addressed, and some solutions based on recent experiences in conducting several qualitative studies are proposed. The following are some guidelines for implementing an intuitive approach to analyzing and reporting qualitative data: (1) use a team of evaluators; (2)…

The research reported in this article lends support to using matrix sampling procedures with paired comparisons in survey research. When a large number of items are to be assessed, matrix sampling proves to be a reliable and effective way to obtain survey data. (Author/CT)

This report compared adult basic education (mathematics and reading) programs in the military and elsewhere on academic achievement (exit versus entry level), hours of class time, age groups, tests used, student teachr ratios, teacher chracteristics, and methods. (LY)

Evaluations of the reengineering of business processes in three companies examined the relationship with organizational learning and innovation. Understanding and mapping existing processes helped identify weaknesses; skills required to make processes operational were clarified; implementation of the reengineering was facilitated by knowledge of…

Introduces this special issue on multilevel models. The first two articles examine the application of multilevel modeling (MLM) in the evaluation of large-scale multi-site interventions. The next two articles focus on developmental and longitudinal data analysis, and the last two describe innovative applications of MLM. (SLD)

Evaluating the impact of volunteer programs should measure both program outcomes and volunteer growth and development. The Targeting Outcomes of Programs Model is a structured way to collect data on several levels. (SK)

This study aimed to investigate the transformational impact of introducing significant new learning technology in an Australian university over the time period 2007-2009. The exploration of this transformation is grounded in a social-ecological systems approach to the management of technology enhanced learning environments in the face of constant…

All evaluators face the challenge of striving to adhere to the highest possible standards of ethical conduct. Translating the AEA's Guiding Principles and the Joint Committee's Program Evaluation Standards into everyday practice, however, can be a complex, uncertain, and frustrating endeavor. Moreover, acting in an ethical fashion can require…

Coalitions have key roles in helping their communities accomplish the following: (1) Track the level of literacy in the community; (2) Use that information to help identify what, and how much, literacy assistance is needed; (3) Assess the extent to which community literacy programs are meeting the need, including how well existing literacy…

The low representation of culturally, linguistically, and ethnically diverse (CLED) and high-poverty students in gifted and talented programs has long been an area of concern. This qualitative study investigated methods to increase successful participation of CLED students in gifted programs across the nation. Twenty-five programs were selected…

Although random assignment is generally the preferred methodology in impact evaluations, it raises numerous ethical concerns, some of which are addressed by securing participants' informed consent. However, there has been little investigation of how consent is obtained in social experiments and the amount of information that can be conveyed--and…