Each year, Austin Independent School District Department of Research and Evaluation (DRE) staff develop a plan of work to describe the scope of work for the coming year. The plans that make up this document identify programs to be evaluated and services to be provided by DRE staff and provide the blueprints for evaluation that staff will follow…

The U.S. Department of Education (ED) expects all Teacher Incentive Fund (TIF) grantees to conduct an evaluation of their programs. Experience with earlier rounds of TIF grants has shown that evaluations can provide valuable information for managing and improving TIF-supported activities, as well as evidence that these activities have had a…

Assessment is a crucial component of gifted education. Not only does it facilitate the recognition of the potential and specific needs of gifted students, it also monitors the progress and growth of gifted students, and allows for the evaluation of gifted education programs. In the present review, we synthesize the literature on assessment in…

Randomized controlled trials are the gold standard in research but may not fully explain or predict outcome variations in community-based interventions. Demonstrating efficacy of externally driven programs in well-controlled environments may not translate to community-based implementation where resources and priorities vary. A bottom-up evaluation…

This tool is a simplified version of the evaluation framework developed by Wenger, Trayner, and de Laat (2011), building upon Kirkpatrick (1976, 1994). These internationally recognized experts on professional learning and collaboration developed their value creation framework to address the dual challenges of attending to the diversity of types of…

In this paper, the author talks about some recent developments in the methodology of program evaluation and about what he calls "responsive evaluation." He discusses two models for program evaluation, namely (1) informal study or self-study; and (2) the pretest/posttest model. Then, he describes an approach that he has been working on, which will…

Research Findings: The Early Childhood Environment Rating Scale-Revised (ECERS-R) is widely used, often to evaluate whether preschool programs are of sufficient quality to improve children's school readiness. We examined the validity of the measure for this purpose. Item response theory (IRT) analyses revealed that many items did not fit together…

Classification evaluation metrics are often used to evaluate adaptive tutoring systems-- programs that teach and adapt to humans. Unfortunately, it is not clear how intuitive these metrics are for practitioners with little machine learning background. Moreover, our experiments suggest that existing convention for evaluating tutoring systems may…

Research Findings: The Early Childhood Environment Rating Scale, Revised (ECERS-R) is widely used, often to evaluate whether preschool programs are of sufficient quality to improve children's school readiness. We examined the validity of the measure for this purpose. Item response theory (IRT) analyses revealed that many items did not fit together…

Service-Learning has evolved beyond simply asking to have students engage in community activities. Service-Learning has become an integral part of our educational system. Having the ability to judge the effectiveness of a service-learning project has become an important component in Higher Education. The purpose of this article is to provide a…

Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…

Extensive graded reading (EGR) was carried out with a cohort of 600 engineering students in a university in northern Japan. Pre-and post-surveys were conducted to discover changes in the general reading habits of students, their attitudes toward the assessment method and how goals changed over the course of study. The first survey was carried out…

This paper presents a newly implemented model of principal preparation at a public university in the southwestern United States. The authors begin by identifying a number of innovative practices currently being carried out within educational administration programs across the United States. Informed by the context of these national models, the…

From a utilization-focused evaluation perspective, the success of an evaluation is rooted in the extent to which the evaluation was used by stakeholders. This paper details the "Expectations to Change" (E2C) process, an interactive, workshop-based method designed to engage primary users with their evaluation findings as a means of…

A paradigm is presented for student learning outcome assessment in information systems education. Successful deployment of the paradigm is illustrated using the author's home institution. The paradigm is consistent with both the scholarship of teaching and learning and the scholarship of assessment. It is concluded that the deployment of the…