Peer review is integral to the evaluation of grant proposals. Reviewer perceptions and characteristics have received limited study, especially their associations with reviewers' evaluations. This mixed methods study analyzed the unstructured comments of 270 experienced peer reviewers after they scored proposals based on mock overall evaluations…

In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed…

Innovation agencies, that is organizations with the primary focus of funding applied research and technological development, evaluate project proposals to select the most promising proposals for funding. At the moment, there is only little verified knowledge available on project evaluation and selection processes of innovation agencies. We want to…

In recent decades, a number of training environments have moved toward program approaches targeting the development of competencies. Because of their complexity, monitoring the development of those competencies is a considerable challenge. Our hypothesis is that a computerized system could help overcome this challenge if it is well accepted by its…

An increasing number of foundations are embracing racial equity/equity as a core value, and it is influencing how they see themselves and operate. However, evaluation has for the most part remained untouched. Knowing how race/racism has influenced both, philanthropy and evaluation, deepens our understanding of how philanthropic evaluation practice…

This first-ever look at the national charter school pipeline--what schools are being proposed and by whom--reveals a diverse sector, with a tremendous variety of applicants and school models. Working with Public Impact, National Association of Charter School Authorizers (NACSA) collected and analyzed nearly 3,000 charter school applications…

This article presents a content analysis of the 2013 School Leadership Program (SLP) grants. SLP projects provide a unique opportunity for participants in the field to explore innovative leadership preparation and development and their impact on program participants, schools, school districts, and students. The article begins with an overview of…

Call it innovation, creativity, imagination, cutting edge, paradigm shift, or any other term for new information, an assessment of innovation may now impact the final decision on awarding grants to investigators. What exactly is innovation and how does the reviewer perceive innovation in the research approach? Procedures, the approach, and…

This study is a content analysis of selected federally funded leadership preparation program evaluation proposals for the 2008, 2009, and 2010 School Leadership Program grants. The United States Department of Education (USDE) began awarding funding in 2002 to develop and implement preparation programs for aspiring and current assistant principals…

The authors present an approach for educating future evaluators by connecting evaluation theory and practice, organizational development, and grant making through experiential learning. They position this discussion on the conceptual framework of a newly developed graduate-level evaluation course, Advanced Program Development and Evaluation, which…

This scenario discusses a situation in which a proposal has been published by a consortium of foundations for an "external" evaluator to evaluate a replication at two new sites of a program they have been funding for many years. A proposal is received from Dr. Porto-Novo, who has been the external evaluator of the initial program for about 10…

Based on 3-year evaluation of Utah State Office of Education (USOE) programs funded and operated under Title IV of the Elementary and Secondary Education Act, this manual suggests steps and procedures for use by the USOE or other similar agencies responsible for soliciting and reviewing proposals for funding of educational programs. Steps include:…