This short brief for education decision makers discusses three main factors that may contribute to a finding of no effects: failure of theory, failure of implementation, and failure of research design. It provides readers with questions to ask themselves to better understand "no effects" findings, and describes other contextual factors…

Intended to guide scholars who are new to qualitative research, this methods brief focuses mostly on what reviewers look for in manuscripts submitted for publication. The author acknowledges that reviewers' preferences likely reflect their theoretical perspectives, research-oriented coursework, mentors, and research and writing experiences. The…

Youth-led group work shifts power dynamics and repositions youth as leaders in driving the learning they envision for themselves. This shift calls into question how group facilitators measure outcomes of youth empowerment groups. Youth participatory action research (YPAR) has expanded the field of knowledge production by creating shared spaces…

The Bureau of Prisons (BOP) is responsible for managing the care and custody of approximately 175,000 federal inmates--an estimated 20 percent of whom have been diagnosed with a substance use disorder. The Government Accountability Office (GAO) was asked to review BOP's efforts to provide drug treatment to federal inmates. This report (1)…

Schools and education systems are being challenged to improve the evaluation of teacher professional development, yet there is a lack of practical tools for doing so. This article describes the development and validation of a new instrument to assess teachers' perceptions of the impact of professional development. This instrument, designed to be…

The rapidly growing number of learning materials and repositories makes the issue of how to find the most relevant and best quality resources to be integrated in teaching and learning offers. Thus, effective quality assessment tools are more and more needed. In the present paper, a case-study focusing on quality assurance in a Virtual Mobility…

This article presents a method for using mind mapping to assess social learning outcomes in collaborative environmental restoration and participatory natural resource management initiatives. Using mind mapping for preassessment and postassessment can reveal changes in individual and collective thinking about critical social and ecological issues.…

The objectives of the audit were to determine whether the Puerto Rico Department of Education (Puerto Rico): (1) submitted complete, accurate, and reliable Adult Education program performance data to the U.S. Department of Education (Department); (2) ensured that Adult Education program funds were used in accordance with applicable Federal and…

People providing services to schools, teachers, and students want to know whether these services are effective. With that knowledge, a project director can expand services that work well and adjust implementation of activities that are not working as expected. When finding that an innovative strategy benefits students, a project director might…

The goal of this study is to better understand how methods for estimating treatment effects of latent groups operate. In particular, the authors identify where violations of assumptions can lead to biased estimates, and explore how covariates can be critical in the estimation process. For each set of approaches, the authors first review the…

The case study presented in this article is an example of an implementation evaluation. The evaluation investigated significant components of the implementation of a long-term environmental educational program. Direct observation, evaluation-specific survey data, and historical data were used to determine program integrity as identified by…

The "Integrated Approaches to Supporting Child Development and Improving Family Economic Security" project was conducted by Mathematica Policy Research and Northwestern University for the Office of Planning, Research and Evaluation (OPRE), in the Administration for Children and Families (ACF) at the U.S. Department of Health and Human…

A mind mapping approach to evaluation called Ripple Effects Mapping (REM) has been developed and used by a number of Extension faculty across the country recently. This article describes three approaches to REM, as well as key differences and similarities. The authors, each from different land-grant institutions, believe REM is an effective way to…

There is a need for a holistic usability evaluation framework that accommodates social constructivist online courses. Social knowledge construction may not be adequately evaluated using current frameworks. This qualitative research study examined the usability needs of a social constructivist online course. Data from an online course were analyzed…

Prior Learning Assessment (PLA) is the evaluation and assessment of learning gained outside a traditional academic environment for college credit, certification, or advanced standing toward further education or training. The term PLA encompasses a wide spectrum of assessment methods, including, but not limited to, credit by examination, challenge…