The "Integrated Approaches to Supporting Child Development and Improving Family Economic Security" project was conducted by Mathematica Policy Research and Northwestern University for the Office of Planning, Research and Evaluation (OPRE), in the Administration for Children and Families (ACF) at the U.S. Department of Health and Human…

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

Arts-based knowledge translation (ABKT) is a process that uses diverse art genres (visual arts, performing arts, creative writing, multimedia including video and photography) to communicate research with the goal of catalysing dialogue, awareness, engagement, and advocacy to provide a foundation for social change on important societal issues. We…

This brief provides tips for forming a team of staff and consultants with the needed expertise to make key measurement decisions that will ensure high-quality data for answering the study's research questions. The brief outlines the main responsibilities of measurement team members. It also describes typical measurement tasks and discusses…

This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

Content analysis of critical events methodology is demonstrated in an evaluation of the Educational Telecommunications for Alaska (ETA) Project. This methodology was used to collect and interpret the data derived from the ETA staff personnel representing five components of the project. The data were analyzed using content analysis procedures. The…

All evaluators face the challenge of striving to adhere to the highest possible standards of ethical conduct. Translating the AEA's Guiding Principles and the Joint Committee's Program Evaluation Standards into everyday practice, however, can be a complex, uncertain, and frustrating endeavor. Moreover, acting in an ethical fashion can require…

The Project on Secondary Analysis directed its attention to methodology and policy issues, focusing on reanalysis of existing data (1979-82)--surveys, program evaluations, etc.--as a vehicle for learning how to improve methods of obtaining and analyzing data, designing program evaluations, and constructing policy to enhance the quality and utility…

The REDSIL model for ongoing evaluation of gifted education programs involves interviewing stakeholders, isolating and categorizing critical study issues, designing a data collection plan that uses several forms of qualitative methods, implementing the plan, analyzing data, searching literature relative to each issue, analyzing data again, and…

This guide is intended to assist states and service delivery areas (SDAs) in addressing the new oversight responsibilities and opportunities stipulated by the Job Training Partnership Act (JTPA) with respect to implementing net impact evaluations. The following topics are covered in the individual chapters: the objectives and major provisions of…

Guidelines for conducting departmental reviews are presented to help review panels, departments being reviewed, and administrators. In planning a review, the following considerations are important: the purpose of the review and the terms of reference, the organization of the review and who will conduct it, and the information that will be…

The purpose of this Guide is to advise researchers, policymakers, and others on when it is possible to conduct a high-quality randomized controlled trial in education at reduced cost. Well-designed randomized controlled trials are recognized as the gold standard for evaluating the effectiveness of an intervention (i.e., program or practice) in…

The study summarizes discussions and conclusions of the Regional Workshop on Monitoring and Evaluation of Rural Development Projects in East Africa (Nairobi, Kenya, April 1979), whose purpose was to share lessons learned from field experiences in managing information for rural development. An initial section summarizes information in papers…

This book provides conceptual and practical strategies for the data and information collection and analysis needs of a diverse group of institutions, ranging from small rural community colleges to large urban research institutions. The model framework is designed for use by any size or type of institution and gives a broad overview of various…