This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

External and implementation factors and their potential threats to field test validity and the practical realities of the field testing process on results are discussed. External factors include site selection, negotiations, contracts, site monitoring, training, and type of product. Implementation factors include motivation, dependence on local…

Practical advice on frequently asked questions dealing with research and evaluation methodology is presented as rules of thumb, with citations to the author's sources. A statement in the literature is considered a rule of thumb if it meets one of the following criteria: (1) it is specifically called a rule of thumb; (2) it contains numbers in…

Principles of program evaluation research are outlined so that bilingual education program coordinators can conduct methodologically acceptable program evaluations. The three basic principles of evaluation research are: identification of the program participants, definition of the program intervention, and assessment of program effectiveness.…

The review of current evaluation practice indicates a failure to provide information relevant to policy makers and service consumers due to investigation of restricted range of outcomes, inattention to ecological context of behavior, and methodological weaknesses. Promising directions in measuring quality of life and pertinent environmental…

Discusses problem preparation and specification along with search strategies and techniques employed by an information scientist in assisting users of on-line data bases, and briefly reviews ways to save computer time. (CWM)

The goals of exploratory and confirmatory factor analysis are described, and procedural guidelines for each approach are summarized, emphasizing the use of factor analysis in developing and refining clinical measures. Recent examples of the use of factor analysis are reviewed and used to highlight controversies that can emerge. (SLD)

Reports on a program held at the 1986 American Library Association Conference which offered a model for locating and evaluating existing research on libraries. Six guidelines for evaluating research are provided, and small group sessions which evaluated actual research and talked directly with researchers are described. (EM)

Develops generalizations for empirical evaluation of software based upon suitability of several research designs--pretest posttest control group, single-group pretest posttest, nonequivalent control group, time series, and regression discontinuity--to type of software being evaluated, and on circumstances under which evaluation is conducted. (MBR)

Presents five research designs--sequential analysis, value added analysis, nonequivalent dependent variables, regression discontinuity, cohort design--for studying computer-based teaching methods when a randomized two-group design is impractical; provides examples of studies employing these designs and decision flowchart; and discusses selection…

Threshold analysis (TA) is introduced as an evaluation model. TA converts unknown variables into questions as to whether a given benefit, cost, or success probability is more or less than a threshold, above which the proposed project would be profitable, and below which it would be unprofitable. (Author/PN)

From her review of the final evaluation reports of 81 career education projects, the author notes seven common pitfalls in career education program evaluation. For a related article by this author, see pp75-83 of this issue. (SJL)

This document is designed to provide an understanding of the major longitudinal issues and problems, a rationale for longitudinal studies, and the advantages and disadvantages of using longitudinal studies for evaluation and accountability purposes when applied to vocational education. Following an introductory chapter, chapter 2 presents a…

Perhaps no facet of long-term care (LTC) research has received as much attention as the evaluation of community-based LTC demonstrations. Recent thinking has called into question the validity and policy relevance of the findings of these studies, yet their efforts will continue to receive strong financial backing. The time has come for LTC…

Reviews problems with research in determining the effectiveness of distance education, and presents a systems model to be used as a framework upon which researchers can build. The telecommunications in instruction model incorporates learner variables, instructor variables, presentational elements, course content elements, and distance education…