Meta-analysis is a collection of systematic techniques for resolving apparent contradictions in research findings. Meta-analysts translate results from different studies to a common metric and statistically explore the relations between study characteristics and findings. Since G. Glass first used the term "meta-analysis" in 1976, it has…

Part of a volume which explores current issues in service delivery to infants and toddlers (ages birth to 3) with handicapping conditions, this chapter presents program evaluation as a comprehensive process comprising three phases: input, process, and output. Three program evaluation models are summarized: Tyler's objective model, Scriven's…

This digest describes the organization of the National Assessment of Educational Progress (NAEP) and what is included in a typical NAEP assessment. The way in which the NAEP selects students for assessments and how the assessments are used are discussed. The NAEP is a congressionally mandated project of the National Center for Education…

To help vocational education administrators and practitioners, this paper presents a framework for vocational education program evaluation. Evaluation is defined as the act of rendering judgments to determine a program's value; two major types are formative and summative. Vocational education evaluation should take a broader and more comprehensive…

Thoughtful, well-planned and systematic reviews of both instructional and noninstructional programs provide community colleges with a way of determining whether programs are meeting stated objectives and what standards of performance should be maintained. Programs that need improvement or should be eliminated can be identified, and fiscal…

The original impetus for this monograph was a grant from the New Jersey Basic Skills Council of the New Jersey Department of Higher Education to evaluate two college basic skills remedial programs (one in a four-year state college, one in a two-year community college) and to produce a handbook for conducting such evaluations. This monograph is…

Schools are realizing that carefully collected and analyzed data represent the key to educational improvement. This digest outlines the most useful types of data to drive the school-improvement process, steps that must be taken to collect and analyze data, the role of administrators in guiding the data-driven reform process, and results that can…

This brief paper defines participatory action research, reviews the literature on its use, and offers examples of how researchers and practitioners are applying principles of participatory action research data to select effective practices and support change and innovation in schools. Generation of data-based strategies in natural environments is…

Biographical inventory is a selection device used as an alternative or supplement to cognitive testing because this measurement method predicts aspects of job performance that are not predicted by cognitive measures. Some of the issues and concerns about using biographical inventories are discussed. The use of biographical inventories (biodata) is…

The 2002 reauthorization of the Elementary and Secondary Education Act mandates that schools receiving federal funding must desegregate their student performance data by race, gender, and socioeconomic status in order to provide progress information to the community and state. Data-driven decision making is particularly important in urban schools…

Assessment is broader in scope than testing. Typically, assessment includes gathering and integrating information about a client in a manner that promotes effective treatment. This digest discusses how counselors can use assessment as a continuous process throughout treatment. It also reviews three common forms of assessment techniques which can…

Student tracking systems are enabling increasing numbers of community colleges to respond to external demands for accountability with tangible measurements of student progress and institutional outcomes. Several recent trends in marketing, accountability, communications with students, and internal competition for resources have prompted interest…

This digest discusses the difficulty of assessing the speech and language of culturally and linguistically diverse students and recommends strategies for identifying communication disorders. It begins by reviewing what qualifies as a communication disorder, discussing the limitations of speech and language tests, and outlining test considerations.…

This Digest discusses computer assisted advisory practices currently in use in community colleges, outlining the types of data collected and how they are used, including the use of tracking to plan interventions for at-risk students. Enhanced computer technology has improved the effectiveness of academic advising by enabling more thorough and…

Some steps to identify an initial set of indicators and to develop alternative indicator systems are outlined for educational evaluation and illustrated through the example of a National Science Foundation (NSF) study of mathematics and science education. The first step is to conceptualize potential indicators to specify a comprehensive monitoring…