Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

The purpose of this brief is to understand the Illinois College and Career Readiness (CCR) Act in light of David Conley's college readiness model. Although not mentioned specifically by the Illinois statute, evaluation results gathered by the Office of Community College Research and Leadership (OCCRL) show alignment between a number of programs…

Student success is at the heart of both institutional effectiveness and the community college mission, yet measuring such success at community colleges is problematic. This article highlights three efforts to grapple with this problem--a multistate work group of system- and state-level policymakers to create an improved set of student success…

Purpose: Nursing home pay-for-performance (P4P) programs are intended to maximize the value obtained from public and private expenditures by measuring and rewarding better nursing home performance. We surveyed the 6 states with operational P4P systems in 2007. We describe key features of six Medicaid nursing home P4P systems and make…

Since the first child care Quality Rating System (QRS) was implemented in Oklahoma 11 years ago (in 1998), 16 additional statewide systems have been launched and numerous states are piloting or developing a QRS (Zaslow, Tout, & Martinez-Beck, forthcoming). As QRS stakeholders across the nation look ahead to the next decade, it is important to take…

Six principles for statewide assessment are discussed: (1) involve the community; (2) specify and define goals; (3) use measuring devices with face and content validity; (4) take noncognitive effects of school into account; (5) design data presentation for lay understanding; and (6) do not let assessment be an end in itself. Decisions to be made…

Using the evaluation of day care programs at the state level as a basis, this document focuses on the methodology, logistics, politics, and benefits of state-wide efforts, particularly as these efforts relate to the impact of day care services on the children served. Since every evaluation effort must be individually tailored, and each state's day…

Developed an empirical strategy for studying broad-based educational change using quantitative methods and an extensive database consisting of state policy indicators and data on schools and classrooms from states participating in the National Assessment of Educational Progress. Results of a Rasch analysis indicate that patterns of state policy…

This study explores an alternative approach to educational program and policy evaluation by using two major educational measurement/analysis methods, and illustrates their integrated applications to evaluating state reform policies. Most evaluations have been done one program at a time, but it is desirable to design evaluation research in a way…

The discussed and illustrated principles regarding teacher performance data and decision making are common sense ideas that have been developed based on a good deal of thought about the definition of minimally acceptable job performances. The presented scoring systems are ways of describing how much a teacher must do in order to be scored…

This paper describes the scoring of the upper levels of the Career Ladder system for teachers in the Tennessee Career Ladder Evaluation Systems. The instruments used to evaluate teachers include classroom observation, dialogue with the teacher, a peer questionnaire, student questionnaires, a professional skills test, professional development and…

Focusing on the problems of assessing the speaking skills of secondary school students, this paper provides one example of how those problems were addressed in the Massachusetts speaking assessment. The paper identifies four requirements for measures of speaking skills: (1) feasibility, (2) reliability, (3) validity, and (4) freedom from bias. The…

Consisting of materials presented to the institute on evaluation of the Illinois gifted program, the document presents papers on educational evaluation and the evaluator's role in education. Also, the development of evaluation designs is considered and four evaluation plans are detailed. Questions regarding evaluation are listed; also listed…

The duplex design is proposed for educational assessment within a state school system. For individual students, scaled proficiency measures that are suitable for guidance and certification at various levels of attainment are provided. For classrooms or larger units, the design can supply group level measures for evaluation and research. (SLD)

This special double issue focuses on the issue of alternative assessment and its place in educational reform. "Alternative Assessment: A National Perspective" (T. Stefonek) emphasizes that the fundamental purposes of new assessment methods are grounded in educational goals, meaningful outcomes, and curricular and instructional programs…