In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Purpose: This paper highlights the potential value of "return on investment" analysis for leadership development investment methods to better providing research informed decision regarding improving organisational outcomes. Design/methodology/approach: Working with published research on leadership dimensions with greatest impact on…

This report presents a summary of the findings of Fiscal Year (FY) 2012 monitoring reviews, fulfilling the reporting requirement, Section 641A(f), of the Head Start Act. It highlights the enhancements made to the FY 2012 monitoring review system, summarizes grantee review outcomes, and describes the types of findings most commonly identified in FY…

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

Peer education is used as a health promotion strategy in a number of areas, including sexual health. Although peer education programmes have been around for some time, published systematic evaluations of youth sexual health peer education programmes are rare. This article discusses the advantages and disadvantages of youth sexual health peer…

A multitude of studies has assessed the success of different technology initiatives but rarely has the focus been on special groups. This paper examines whether university students with children and those without have different perceptions of a technology initiative where students were able to acquire university sponsored laptops and were provided…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

Between good intentions and great results lies a program theory--not just a list of tasks but a vision of what needs to happen, and how. Now widely used in government and not-for-profit organizations, program theory provides a coherent picture of how change occurs and how to improve performance. "Purposeful Program Theory" shows how to develop,…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

The strong demand and rapid increase in the number of programs concerning distant education programs has put the quality problem of distant education services into the agenda. It is crucial to determine the strengths and weaknesses of distant education programs, the problems encountered by these programs and making the required improvements. The…

This paper describes a randomised controlled trial conducted with 10 secondary schools in England to evaluate the impact and feasibility of Fresh Start as an intervention to help new entrants with low prior literacy. Fresh Start is a synthetic phonics programme for small groups of pupils, here implemented three times per week over 22 weeks. The…

Purpose: In the higher education sector, the evaluation of learning and teaching projects is assuming a role as a quality and accountability indicator. The purpose of this paper is to investigate how learning and teaching project evaluation is approached and critiques alignment between evaluation theory and practice. Design/Methodology/Approach:…

Cooperative and Work-integrated Education (CWIE) programs have been widely accepted as educational programs that can effectively connect what students are learning to the world of work through placements. Because a global quality standards framework could be a very valuable resource and guide to establishing, developing, and accrediting quality…

States, programs, and schools have long focused on the inputs of teacher preparation--the rules for candidates and the preparation programs they attend--because inputs were thought to predict teacher effectiveness, and because they were often the best option available. But in the early 2000s, policymakers began trying to evaluate preparation…

The Young Readers Programme (YRP) motivates children to read for enjoyment by running a series of three literacy-focused events, teaching children strategies to choose books that are right for them, and showing them that reading can be enjoyable. One of the most effective ways of developing children's literacy skills is to engage them in reading…