The purpose of this explanatory sequential mixed methods study was to examine faculty perceptions of distance course quality review feedback at a small healthcare-focused college in the United States. The Examining the Evaluator Feedback Survey tool was adapted and used to determine faculty perceptions (N=16) of five key aspects of reviewer…

One of the core outcomes of the Sixth International Conference on Adult Education (CONFINTEA VI) held in 2009 was the Belém Framework for Action (BFA). Its signatories committed to monitoring the most recent development stages of adult learning and education (ALE) worldwide on a regular basis, and to present and assess results in a global report.…

Analysis of symmetrically predicted endogenous subgroups (ASPES) is an approach to assessing heterogeneity in an ITT effect from a randomized experiment when an intermediate variable (one that is measured after random assignment and before outcomes) is hypothesized to be related to the ITT effect, but is only measured in one group. For example,…

The debate over what counts as credible evidence often occurs on a methodological level (i.e., about what technical applications of systematic inquiry provide believable, justifiable claims about a program). Less often, it occurs on an epistemological level (i.e., about what ways of knowing are appropriate for making claims about a program). Even…

This article examines the concept of credible evidence in Extension evaluations with specific attention to the measures and measurement strategies used to collect and create data. Credibility depends on multiple factors, including data quality and methodological rigor, characteristics of the stakeholder audience, stakeholder beliefs about the…

Past efforts to address endemic rates of sexually transmissible infections amongst young Aboriginal people living in remote/very remote Australian communities have had limited success. Peer education has been used in youth sexual health promotion but has received limited evaluation and has not been tested in remote Aboriginal settings. The Young…

To mark the ten year anniversary since the introduction of the free schools programme, New Schools Network (NSN) commissioned the National Foundation for Educational Research (NFER) to conduct an independent data-led investigation into what impact free schools have had since their introduction in 2010. The research examines the impact that free…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…

Adult basic education (ABE) policies aim to help adults improve their literacy, numeracy and information and communications technology skills, as well as their qualifications, often in pursuit of economic gains such as better employment and earnings. The large-scale improvement of skills and qualifications has been referred to as a wicked policy…

The public value poster session is a new tool for effectively demonstrating and reporting the public value of Extension programming. Akin to the research posters that have long played a critical role in the sharing of findings from academic studies, the public value poster provides a consistent format for conveying the benefits to society of…

Evaluation capacity building (ECB) is an essential element for generating credible and actionable evidence on Extension programs. This paper offers a discussion of ECB efforts in Cooperative Extension and how such efforts enable Extension professionals to collect and use credible and actionable evidence on the quality and impacts of programs.…

Several analytic strategies exist for opening up the "black box" to reveal more about what drives policy and program impacts. This article focuses on one of these strategies: the Analysis of Symmetrically-Predicted Endogenous Subgroups (ASPES). ASPES uses exogenous baseline data to identify endogenously-defined subgroups, keeping the…

Programmatic assessment is both a philosophy and a method for assessment. It has been developed in medical education as a response to the limitation of the dominant testing or measurement approaches and to better align with changes in how medical competence was conceptualised. It is based on continual collection of assessment and feedback…

This article provides a look at the various levels within the Cooperative Extension System and the use of evidence within these levels. The authors examine the factors associated with credible evidence and the various levels. The impact of factors such as politics, science, stakeholder support, and expectations are discussed. The various levels…

Intended to guide scholars who are new to qualitative research, this methods brief focuses mostly on what reviewers look for in manuscripts submitted for publication. The author acknowledges that reviewers' preferences likely reflect their theoretical perspectives, research-oriented coursework, mentors, and research and writing experiences. The…