Methodological rigor consists of a series of elements that, in combination, determine the confidence with which conclusions can be drawn from the evaluation results. These elements include evaluation design, conceptualization of constructs, measurement strategies, time frames, program integrity, and others. The authors examine the factors that…

This article describes an effectiveness evaluation of an intensive case management intervention coordinated by a non-profit organization in a midsize Midwest City. As an effectiveness evaluation, the primary evaluation question was causal in nature; the key task of the evaluative study was to establish and probe connections between the…

In 2006 and 2007, the U.S. Department of Education (ED) awarded $478 million in grants from the Teacher Incentive Fund (TIF) to support the development of innovative teacher compensation strategies. New Leaders for New Schools (NLNS), together with five partners--Memphis City Schools (MCS), the District of Columbia Public Schools (DCPS), Denver…

As part of its work to advance the multiple pathways approach to high school education, the James Irvine Foundation engaged the Bridgespan Group to develop a framework for assessing the nature and needs of the fields in which nonprofits operate. These agents of change often struggle to understand how to focus their field-building investments and…

Recent work has shown that many state supported school counseling programs have not developed working statewide program evaluation schemas. This study examined two exemplary examples of state level program evaluation. Mixed-method case studies were created and then analyzed across cases to reveal common themes and best practices. The findings…

Background: Services employing staff to support people with disability usually provide training in a range of areas including communication and managing challenging behaviour. Given that such training can be costly and time-consuming, it is important to evaluate the evidence presented in support of such programs. Efficacy in clinical practice is…

This article reports on the implementation of diagnostic assessment in an advanced Spanish language program at the university level. Particular attention is given to the use of dynamic assessment practices as a way to assess language abilities, intervene in learning, and document learners' growth. Dynamic assessment is conceptually based on…

Peer moderation of group work in higher education is rapidly advancing through the use of technological developments and is increasingly being informed by pedagogical research. The highly successful WebPA online assessment system has gone through a number of development phases over its 15-year history and has now evolved into a relatively mature…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

The 2008 Sloan Blended Workshop evaluation track provided participants with ideas, methods, and resources with which to design and evaluate their courses, programs, and blended initiatives. The many questions that arose from participants at the Workshop provided the motivation to document our University's evaluation experiences at course, program…

The use of educational technology in K-12 classrooms has been gaining tremendous momentum across the country since the 1990s. Many school districts have been investing heavily in various types of technology, such as computers, mobile devices, internet access, and interactive whiteboards. Almost all public schools have access to the internet and…

Instructional strategies aimed at improving achievement of low performing student subgroups in need of support were selected by the District Improvement Advisory Committee, so that WCPSS could exit District Improvement status. Impact of each initiative, which often included teacher training and coaching is examined in this implementation report.…

In today's Web 2.0 world, teachers are perpetually struggling with how to incorporate technology into the classroom effectively in order to meet the diverse literacy needs of 21st-century learners. Utilizing the National Council of Teachers of English (NCTE, 2008) Position Statement addressing these needs, the theoretical framework of Lankshear…

The process of developing innovative mobile approaches to informal and formal learning is challenging, not least in needing to satisfy stakeholders with diverse interests in the technology, the pedagogy and the overall system. Some approaches to evaluation may focus on examining the nature and quality of learning that occurs, while other methods…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…