Funders of social interventions that address complex child and family welfare concerns for highly vulnerable populations are increasingly seeking cost-effective and rapid mixed method evaluations of their services. This paper describes a mind mapping approach that was used to collect valid and reliable qualitative data from large numbers of…

By tailoring test forms to the test-taker's proficiency, Computerized Adaptive Testing (CAT) enables substantial increases in testing efficiency over fixed forms testing. When used for formative assessment, the alignment of task difficulty with proficiency increases the chance that teachers can derive useful feedback from assessment data. The…

Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

Since 2005, nearly 600 Physiology Understanding Week (PhUn Week) events have taken place across the U.S., involving American Physiological Society (APS) members in K-12 outreach. The program seeks to build student understanding of physiology and physiology careers, assist teachers in recognizing physiology in their standards-based curriculum, and…

In 2016, the education department at the National Building Museum offered a series of Late Night programs in conjunction with the Summer Block Party installation, ICEBERGS. The museum wanted to evaluate the programs but had limited resources to do so. In the following article, we describe the use of critical appraisal, an economic method applied…

This policy brief summarizes and critiques the findings of the US Department of Education's Section 5005 Report on Rural Education. In September of 2018, the Department of Education released the "Section 5005 Report on Rural Education: Final Report." The report was written in response to a provision of the Every Student Succeeds Act of…

The foster youth education program strives to increase graduation rates by improving academic performance and encouraging student retention through an innovative collaboration between tutors, social workers, and schools to provide individualized support. The pilot program was funded by U.S. Department of Education Innovation Funds, which evolving…

There is a burgeoning body of evidence on the average impacts of educational programs. Yet, for many local decision makers, because impacts can vary across sites, the question of whether a certain program will work in their particular district or school remains. This article addresses the question of the generalizability of large-scale average…

Auditory-visual conditional discrimination training (e.g., receptive identification training, listener responses; AVCD) is ubiquitous in early intervention and special education programs. Nevertheless, some learners with Autism Spectrum Disorder (ASD) do not appear to benefit from this training despite use of empirically validated treatments. To…

The article is aimed at the studies of the assessment practices currently applied in translation training at Ukrainian universities in the context of cutting-edge trends and dispositions in translator's education observed worldwide. They include the synergism of both evaluative and formative assessment, the extensive use of diverse assessment…

Although language samples are child-friendly and well-suited for obtaining global measures of language production, structured protocols have the potential to elicit many different exemplars of language structures in a shorter amount of time. We created a structured elicitation protocol, the Sentence Diversity Priming Task (SDPT), to efficiently…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

The field of Adult Literacy and Numeracy (ALN) has an evidence problem. This paper analyses that problem through the lens of three overarching types of evidence available to researchers and policymakers: Type 1 evidence, which provides descriptions of the scope of social problems; Type 2 evidence measuring the impacts of programmes addressing…

EDUCATE is a London-based programme that supports the development of research-informed educational technology (EdTech), allowing entrepreneurs and start-ups to create their products and services, and simultaneously grow their companies in a more evidence-informed manner. The programme partners businesses with researchers who mentor, guide and…

Simultaneous in-class presentations are well suited to the use of peer evaluation, which also promotes greater involvement of the student audience. The problem for the teacher is how to manage peer evaluation and make it a useful part of the curriculum. PeerEval is a mobile application that allows students to anonymously evaluate presentations in…