Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

Evaluation capacity building (ECB) has become a popular approach for helping community-based organizations (CBOs) to meet their funders' demands for accountability. This case study reports the ECB process with one staff member using a catalyst-for-change approach. The authors analyzed the role of the catalyst in diffusing evaluation knowledge and…

This paper proposes ten steps to make evaluations matter. The ten steps are a combination of the usual recommended practice such as developing program theory and implementing rigorous evaluation designs with a stronger focus on more unconventional steps including developing learning frameworks, exploring pathways of evaluation influence, and…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). This SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). The SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

One prevention strategy for childhood sexual abuse (CSA) involves educational programs delivered to children in the school environment. The purpose of this integrative literature review was to determine the state of the science on school-based CSA prevention programs. The authors extracted data from 26 articles that fit inclusion criteria to…

Purpose: The purpose of this paper is to describe a novel undergraduate course on serious game design and development that integrates both game and instructional design, thus providing an effective approach to teaching serious game design and development. Very little effort has been dedicated to the teaching of proper serious game design and…

Charlotte-Mecklenburg Schools' (CMS) Parent University is an innovative, collaborative initiative designed to engage parents in their children's education. Working with community partners, Parent University offers unique courses and workshops such as Parenting Awareness, Helping Your Child Learn in the 21st Century, Health and Wellness, and…

This article describes lessons learned about implementing evaluations in hospital settings. In order to overcome the methodological dilemmas inherent in this environment, we used a practical participatory evaluation (P-PE) strategy to engage as many stakeholders as possible in the process of evaluating a clinical demonstration project.…

Growing evidence shows that participation in out-of-school time (OST) activities positively supports youth development in general. However, simply participating in a self-identified STEM program is not sufficient. Youth will benefit more if they participate in "quality" afterschool programs. Therefore, a common understanding of quality…

With the increasing demand for accountability of Extension programming, Extension professionals need to apply rigorous evaluation designs. Randomized designs are useful to eliminate selection biases of program participants and to improve the accuracy of evaluation. However, randomized control designs are not practical to apply in Extension program…

This report presents data collected through a questionnaire of State education agencies and local educational agencies on the growing use of social media to reach key stakeholder groups and engage with primary audiences.

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Purpose: This paper highlights the potential value of "return on investment" analysis for leadership development investment methods to better providing research informed decision regarding improving organisational outcomes. Design/methodology/approach: Working with published research on leadership dimensions with greatest impact on…

This report presents a summary of the findings of Fiscal Year (FY) 2012 monitoring reviews, fulfilling the reporting requirement, Section 641A(f), of the Head Start Act. It highlights the enhancements made to the FY 2012 monitoring review system, summarizes grantee review outcomes, and describes the types of findings most commonly identified in FY…