The goal of this study is to better understand how methods for estimating treatment effects of latent groups operate. In particular, the authors identify where violations of assumptions can lead to biased estimates, and explore how covariates can be critical in the estimation process. For each set of approaches, the authors first review the…

An integrated data system (IDS) that links information from separate administrative data systems offers policymakers, program administrators and researchers a powerful tool to analyze interactive effects across systems and make more informed decisions to improve outcomes for vulnerable families. This case study discusses how two states (Washington…

Despite growing interest in data visualization and graphically aided reporting, the evaluation literature could benefit from additional guidance on systematically integrating visual communication design and marketing into comprehensive communication strategies to improve data dissemination. This article describes the role of targeted communication…

The Big Lift is a collective impact initiative extending from preschool to third grade in San Mateo County, California. The collective impact effort consists of people and organizations from various sectors uniting to tackle a single, complicated societal problem -- in this case, third grade reading achievement. The initiative is a partnership of…

The case study presented in this article is an example of an implementation evaluation. The evaluation investigated significant components of the implementation of a long-term environmental educational program. Direct observation, evaluation-specific survey data, and historical data were used to determine program integrity as identified by…

In order to enhance Extension evaluation efforts it is important to understand current practices. The study reported here researched the evaluation behaviors of county-based Extension professionals. Extension professionals from eight states (n = 1,173) responded to a survey regarding their evaluation data collection, analysis, and reporting…

To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

iMentor's College Ready Program is a unique approach that combines elements of school-based mentoring, whole school reform, and technology in an effort to help students develop the full suite of knowledge, behaviors, and skills they need to complete high school and enroll and thrive in college. iMentor partners with high schools that serve…

This article describes an innovative evaluation plan we employed to capture outcomes of a multiyear beginning farmer program and, specifically, highlights the facilitation technique we used to document short-term and intermediate goals of the program that matched U.S. Department of Agriculture grant requirements and Extension administration…

New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

Students learn best when they are in environments in which they feel safe, supported, challenged, and accepted. In addition, environments that have strong school climates foster the social, emotional, and academic well-being of all students. Research shows that when schools and districts effectively focus on improving school climate, students are…

Shortly after we published "Addressing Flawed Research in Developmental Education" (2012) in the "Journal of Developmental Education," Thomas Bailey, Shanna Smith Jaggars, and Judith Scott- Clayton from the Community College Research Center (CCRC) wrote a response rebutting several of our claims. Though their response corrects…

Implementation fidelity assessment provides a means of measuring the alignment between the planned program and the implemented program. Unfortunately, the implemented program can differ from the planned program, resulting in ambiguous inferences about the planned program's effectiveness (i.e., it is uncertain if poor results are due to an…

This brief explores the lessons learned from the 2016 Parents and Children Thriving Together: Two-Generation State Policy Network (PACTT Network), a collaboration between the National Governors Association (NGA) and the Center for Law and Social Policy (CLASP). Through this initiative, five states explored how to use the two-generation approach to…

Increasing adoption and adaptation of promising instructional strategies and materials has been identified as a critical component needed to improve science, technology, engineering, and mathematics (STEM) education. This paper examines typical propagation practices and resulting outcomes of proposals written by developers of educational…