This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Integrative analysis, or what is coming to be known as meta-analysis, is the integration of the findings of many empirical research studies of a topic. Meta-analysis differs from traditional narrative forms of research reviewing in that it is more quantitative and statistical. Thus, the methods of meta-analysis are merely statistical methods,…

Provides a set of guidelines for evaluating research using structural equation modeling (SEM). Offers insight into how someone familiar with SEM would judge the adequacy of a study using such methods. (Author/RH)

This article suggests ways in which the consumer of educational research can critically evaluate research reports in terms of sample and methodology, design and statistical treatment, and results and interpretation. The reader is alerted to sources of deliberate and nondeliberate bias and to fallacious use and/or interpretation of statistics.…

Statistical significance is not a sufficient condition for claiming a hypothesis has been supported. Constructive replications are more important. Statistically significant results may be meaningless while a sequence of nonsignificant results may be quite important. Gives advice on how to overcome some limitations of classifical statistical…

Discusses the problem of dichotomous-dependent variables in regression analysis in student attrition studies. Proposes a new method as an alternative to regression analysis. (Author/RC)

Meta-analysis has become an important supplement to traditional methods of research reviewing, although many problems must be addressed by the reviewer who carries out a meta-analysis. These problems include identifying and obtaining appropriate studies, extracting estimates of effect size from the studies, coding or classifying studies, analyzing…

Twenty-nine steps necessary for data file preparation for secondary analysis are discussed. Data base characteristics and planned use vary the complexity of the preparation. Required techniques (file verification, sample verification, file merger, data aggregation, file modification, and variable controls) and seven associated pitfalls are defined…

Because of limitations on research controls, research designs in postsecondary education are often complex and can involve many independent and potentially confounding variables. What is needed to adequately address such research questions is a flexible and powerful data-analytic approach, and the general linear regression model is recommended.…

This guidebook is designed for data analysts who are working with computer data files that contain records with incomplete data. It indicates choices the analyst must make and the criteria for making those choices in regard to the following questions: (1) What resources are available for performing the imputation? (2) How big is the data file? (3)…

Reflects on some of the problems encountered in the authors' experimental approach to a study of reading comprehension. Discusses the limitations of experimental research, and presents an alternative to experimental or quantitative research, focusing on the relationship between teachers and learners as they interact in classrooms. (MM)

This paper comments on the impact of computers on statistical analysis and presents a concise, nontechnical overview of five statistical methods now being applied in educational research. Appropriate uses of these techniques are pointed out, along with dangers concerning misapplications. (PP)

The failure of educational research to fully allow for limitations in methodology when drawing conclusions is faulted. In addition to this, a failure on the part of the media--educational and other--to fully publicize these limitations is also criticized. Methodological shortcomings of the 1977-78 American Institutes of Research (AIR) study of…

This guide to planning and conducting research projects covers how to decide on a research problem, state a hypothesis, plan for the collection of data, write a proposal, analyze and interpret data, and write the research report. Overall, the book takes a practical, hands-on approach and offers checklists, suggestions, and guidelines for all the…

This publication is primarily designed for educational practitioners who possess little or no training in conducting mail surveys or have not kept current on the present state of the art of survey methods and techniques. It is also intended to be a checking and comparing aid to ensure that important research considerations are taken into account.…