Purpose: As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating…

Over the past 30 years, mixed methods research has become an increasingly popular tool in the social sciences. Mixed methods research can capture a diverse range of perspectives and levels of complexities not always possible with the use of a single methodological approach. It has been effectively implemented in a range of contexts to explore…

Nine years after reconceptualizing the nature of science for science education using the family resemblance approach (FRA) (Erduran & Dagher, 2014a), the time is ripe for taking stock of what this approach has accomplished, and what future research it can facilitate. This reflective paper aims to accomplish three goals. The first addresses…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

In this reflective case, we examine the role and function of collaboration in use-oriented evaluation approaches. Reflecting on our experience evaluating a program that sought to integrate new technologies into K-12 teaching and pre-service teacher education, we found that the desire and pursuit of making evaluation useful can influence why, with…

Study Skills in any guise are integral to Higher Education worldwide, existing to help student success. Some argue generic or bolt-on Study Skills do not help with success, others that embedded Study Skills do, but no-one advocates actually evaluating Study Skills in a context of success defined as helping with student educational gain and…

Background: Mentoring programs pair non-familial adults with children and adolescents for the purposes of promoting positive youth development. Although these programs are widely popular, evaluations tend to show that mentoring programs have, on average, modest effects on youth outcomes. Some researchers have suggested that mentoring programs…

Since 2007, two taxonomies have been proposed to identify the components of evaluation practice that may be specified in an evaluation policy. Little is known, however, about how these taxonomies align with evaluation policies developed by philanthropic foundations. Through thematic analysis, this article first compares 12 foundation evaluation…

Over 2000 years ago, Aristotle wrote of four distinct causes at play in the world we know. Those causes, the material cause, the formal cause, the efficient cause, and the final cause, were meant to refer to ontological and, by extension, epistemological concerns, and were powerful enough to be seized upon and used in some form by those of very…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Several influential reviews and two meta-reviews have converged on the position that teacher professional development (PD) is more effective when it is sustained, collaborative, subject specific, draws on external expertise, has buy-in from teachers, and is practice based. This consensus view has now been incorporated in government policy and…

Active learning promotes the capacity of problem solving and decision making among learners. Teachers who apply instructional processes toward active participation of learners help their students develop higher order thinking skills. Due to the recent paradigm shift toward adopting competency-based curricula in the education of healthcare…

Meaningfully engaging faculty in assessment presents a continual challenge for general education administrators. Faculty perceptions of assessment--including that assessment serves no purpose other than "checking a box" for accreditation and that it conveys little benefit to the instructor--often hinder instructor engagement. A low-cost…

Social return on investment (SROI), an evaluation method that compares monetized social value generated to costs invested, is in ascendance. Conceptually akin to cost-benefit analysis, it shares some of its challenges; however, these are heightened due to the expressed promise of using SROI to compare programs and inform philanthropic and public…

The George Mason University (Mason) offices responsible for institutional reporting and assessment were merged to strengthen and solidify their functions and expertise. The organizational structure creating the Office of Institutional Effectiveness and Planning (OIEP) was intended to engineer a new paradigm where assessment would inform the…