There is a burgeoning body of evidence on the average impacts of educational programs. Yet, for many local decision makers, because impacts can vary across sites, the question of whether a certain program will work in their particular district or school remains. This article addresses the question of the generalizability of large-scale average…

Program evaluations that lack experimental design often fail to produce evidence of impact because there is no available control group. Theory-based evaluations can generate evidence of a program's causal effects if evaluators collect evidence along the theorized causal chain and identify possible competing causes. However, few methods are…

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate…

Purpose: Family support programs commonly use self-sufficiency matrices (SSMs) to measure family outcomes, however, validation research on SSMs is sparse. This study examined the reliability of the Colorado Family Support Assessment 2.0 (CFSA 2.0) to measure family self-reliance across 14 domains (e.g., employment). Methods: Ten written case…

The purpose of this article is to present various single-case outcome assessment methods for evaluating school-based intervention effectiveness. We present several outcome methods, including goal attainment scaling, visual analysis, trend analysis, percentage of non-overlapping data, single-case mean difference effect size, reliable change index,…

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents…

Extension educators have been challenged to be cost effective in their educational programming. The cost effectiveness ratio is a versatile evaluation indicator for Extension educators to compare the cost of achieving a unit of outcomes or educating a client in similar educational programs. This article describes the cost effectiveness ratio and…

This article provides a rationale for "assessment for social justice", through which a greater focus is given to the role of assessment in achieving the social justice aspirations of higher education. It takes inspiration from work on assessment for learning to propose that as assessment is a powerful driver of how and what students…

This chapter addresses financial education across the lifespan, which has the potential to enhance adult financial capability, yet methodological barriers and a lack of robust measures have hampered the ability to identify and measure the effects of educational programs on financial decisions and behavior.

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

"Essential Global Learning" is a compilation of seminal AAC&U articles about global learning. This publication provides a working definition of global learning, a framework for assessment of global learning, and case studies of high-impact global learning activities on a variety of campuses. It is a foundational publication for…

The Research Excellence Framework (REF) is a new system for assessing the quality of research in UK higher education institutions (HEIs). For the first time, part of the assessment included the wider impact of research. RAND Europe was commissioned to evaluate the assessment process of the impact element of REF submissions, and to explore the…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Institutional assessment initiatives can provide opportunities to make the intellectual work of teaching and learning in composition studies more visible. Reciprocally, the scholarship of teaching and learning's situatedness within disciplinary norms and values can enhance institutional assessments, providing a check on the tendency to rely…

The Stirling Children's Well-being Scale (SCWBS) was developed by the Stirling Council Educational Psychology Service (UK) as a holistic, positively worded measure of emotional and psychological well-being in children aged eight to 15 years. Drawing on current theories of well-being and Positive Psychology, the aim was to provide a means of…