Realist evaluations, a form of theory-driven evaluation, aim to explain how, why, for whom, and to what extent a complex health intervention works (or does not work). Realist evaluations are often "methods-flexible" and encourage the appropriate use of a range of evidence types that provide explanatory value. However, there is a lack of…

In 2015, a multidisciplinary group of academic researchers and extension personnel was awarded a US Department of Agriculture Coordinated Agricultural Project grant. The team's goal was to understand human decision-making in the context of potential livestock disease outbreaks, investigating the impediments to increased adoption of biosecurity…

Purpose: When we speak, we gesture, and indeed, persons with aphasia gesture more frequently. The reason(s) for this is still being investigated, spurring an increase in the number of studies of gesture in persons with aphasia. As the number of studies increases, so too does the need for a shared set of best practices for gesture research in…

We interrogate the opportunities and challenges of using mixed methods (MM) within a developmental evaluation (DE) context by drawing on two illustrative cases that investigated educational change in Canada. Methods: Multi-case design and cross-case analysis, with a focus on examining common patterns across the two cases, enabling new ways of…

The questionnaires' origin (sources from which elements of the questionnaire are derived) and initial development (process of making a questionnaire from elements) should be assessed before their measurement properties. There is no Critical Appraisal Tool (CAT) that comprehensively assesses the origin and initial development of questionnaires…

The aim was to analyse the features concerning the applicational purpose and strategy of the most common instruments used to assess game tactics both in Physical Education (PE) and in extra-curricular sport contexts. The review focused on two instruments: the Game Performance Assessment Instrument (GPAI) and the Team Sport Assessment Procedure…

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

Training transfer is a key concern for organizational stakeholders, training professionals, and researchers. Since Georgenson's (1982) article on transfer, his conversational gambit that only 10% of training transfers to performance on the job has been quoted often. This estimate suggests a low level of success with training programs in general,…

This researcher examined the relationship of bureaucratic structure to school climate by means of an exploratory factor analysis of a measure of bureaucracy developed by Hoy and Sweetland (2000) and the four dimensional measure of climate developed by Hoy, Smith, and Sweetland (2002). Since there had been no other empirical studies whose authors…

Horner et al. (2005) present a review substantiating how single-subject research methodology can be utilized to determine whether interventions are evidence-based practices (EBPs). The current study utilized the Horner et al. research piece to: (a) systematically identify a set of quality standards for the evaluation of single-case research…

Instruments for evaluating the implementation of inquiry science in K-12 classrooms are necessary if evaluators and researchers are to know the extent to which programs are implemented as intended and the extent to which inquiry science teaching accounts for student learning. For evaluators and researchers to be confident about the quality of…

The purpose of this study was to apply and explore, in the context of an Icelandic preschool, the methods developed by the New Zealand "Te Whaariki" curriculum to assess children's well-being and learning dispositions. This article describes the process of piloting learning stories as a research method, where researchers and preschool…

As part of the evaluation of schools participating in the Comprehensive School Reform Demonstration (CSRD) program, a site researcher is to visit each participating site twice a year to collect data for CSRD formative evaluation. To prepare site researchers for their evaluation activities, a training and orientation session was held for 18…

As part of the Comprehensive School Reform Demonstration (CSRD) program, schools participated in the Formative Evaluation Process for School Improvement (FEPSI), a package of services mainly provided during two visits each school year. This document reports on the evaluation of training for Georgia educators involved in FEPSI as site researchers.…

The value of qualitative assessment approaches has been underestimated primarily because they are often juxtaposed against long-standing quantitative traditions and the widely accepted premise that the best research produces generalizable and statistically significant findings. Institutional researchers avoid qualitative methods for at least three…