The growth in the availability of longitudinal data--data collected over time on the same individuals--as part of program evaluations has opened up exciting possibilities for evaluators to ask more nuanced questions about how individuals' outcomes change over time. However, in order to leverage longitudinal data to glean these important insights,…

The purpose of this methodological study is to explore how well a process called "concept mapping" (Trochim, 1989) can articulate the theory which underlies a social program. Articulation of a program's theory is a key step in completing a sound theory based evaluation (Weiss, 1997a). In this study, concept mapping is used to…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to select a statistical technique that is appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on classifying a study,…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to determine a sampling method that is appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on why and when to sample,…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to develop an experimental design appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on the characteristics of a good…

Study report of some evidence on the verification of participant evaluation. Results suggest that the participants' evaluation of adult education programs could be an effective tool for the development and refinement of future programs. (Author)

This article is the second contribution to a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information that decision makers can use with confidence when conducting program evaluation and policy…

A solution to the problem of specification error due to excluded variables in statistical models of treatment effects in nonrandomized (nonequivalent) control group designs is presented. It involves longitudinal observation with at least two pretests. A maximum likelihood estimation program such as LISREL may provide reasonable estimates of…

A study explored which nonexperimental comparison group methods provide the most accurate estimates of the impacts of mandatory welfare-to-work programs and whether the best methods work well enough to substitute for random assignment experiments. Findings were compared for nonexperimental comparison groups and statistical adjustment procedures…