The paper presents a comprehensive approach to evaluation of programs for postsecondary students with learning disabilities. The evaluation design is suitable for programs in 2-year and 4-year settings, and incorporates both process and product evaluation methods. The approach was used to evaluate learning disability support services at Housatonic…

This document describes the development and assessment of a methodology for generating on-the-job-training (OJT) task proficiency assessment instruments. The Task Evaluation Form (TEF) development procedures were derived to address previously identified deficiencies in the evaluation of OJT task proficiency. The TEF development procedures allow…

This paper presents criteria for establishing the trustworthiness of naturalistic inquiries, and specific techniques to facilitate their achievement or determine the degree of their achievement. The following criteria are briefly described: fairness; and ontological, educative, catalytic and tactical authenticity. Explored in greater detail,…

As a step in combining three of the Elementary and Secondary Education surveys of the National Center for Education Statistics to produce one database linking local education agencies, schools, and teachers, the merged procedures and collections forms were pretested. Different methods were tested by splitting the pretest sample of 220 public…

Thoughtful, well-planned and systematic reviews of both instructional and noninstructional programs provide community colleges with a way of determining whether programs are meeting stated objectives and what standards of performance should be maintained. Programs that need improvement or should be eliminated can be identified, and fiscal…

Two innovative methods for collecting and analyzing qualitative data are vignettes and pre-structured cases. Vignettes are descriptions of situations or problems written by a professional, with a suggested outline and comments provided by a researcher. Advantages of this method are strength of impact of the written descriptions and efficiency of…

The checklists, tips, and examples will help persons involved with youth participation projects demonstrate the impact of a project. They will also help check for project strengths and weaknesses. Including the introduction, there are seven chapters. Chapter 2, "How Should Your Evaluation Look?" discusses what questions should be asked,…

The techniques and accompanying problems of collecting data on interventions are explored. As a result of the analyses of two previous studies (Colorado and Kentucky Ethnographic Studies, 1979; and Texas, 1981) a hybrid-method of documenting interventions was developed for use in the Principal-Teacher Interaction Study (PTI). This paper traces the…

Physicians, psychologists, and anthropologists have developed procedures and models for preparing case studies that meet the needs of their profession. In the field of educational evaluation, procedures for conducting student case studies are not readily available. Although case studies, consisting of descriptions of exemplary educational…

The original impetus for this monograph was a grant from the New Jersey Basic Skills Council of the New Jersey Department of Higher Education to evaluate two college basic skills remedial programs (one in a four-year state college, one in a two-year community college) and to produce a handbook for conducting such evaluations. This monograph is…

Because a lack of adequate data eliminated the possibility of using control groups or historical comparison groups, Colorado's procedure for evaluating state bilingual/bicultural programs was designed to determine whether children in the bilingual program (K-3) had learned more than they would have learned if they had not been in the program. A…

Data from 8 of the 13 instruments used to provide answers to the decision and evaluation questions for evaluation of the 1980-81 ESEA Title I regular program in the Austin (Texas) Independent School District comprise Volume II of the final technical report. A separate appendix for each instrument includes a description of its purpose, procedure,…

One of a series of reports concerned with the creation of new evaluation methodologies for use in education, this report contains a collection of thirteen brief statements of problems encountered first-hand by evaluation practitioners in state departments of education (SEAs). Its intent is to make available practitioner statements so that further…

This guide describes the types of instruments to be used in the evaluation of Iowa's experience-based career education (EBCE-MD) project for mildly mentally disabled secondary students. Part 1 provides an overview of the formative evaluation data required for project operation. Copies of various instruments are included (instructor questionnaire,…

Plans are presented for the overall design of the longitudinal evaluation of the National Institute of Education's State Capacity Building Program. Both the process of developing comprehensive dissemination capacity in state education agencies, and the impact of the capacity building activities will be studied. This report describes the…