Meta-analyses of educational research findings frequently involve statistically dependent effect size estimates. Meta-analysts have often addressed dependence issues using ad hoc approaches that involve modifying the data to conform to the assumptions of models for independent effect size estimates, such as by aggregating estimates to obtain one…

This paper presents a new methodological model termed Airbag Moderation: That the relationship between two variables varies as a function of a third, and that this third variable depends upon one of the others. Airbag Moderation extends and bridges a number of theories and it can be implemented using existing statistical models and software…

Cooperative learning is a well-known instructional technique that has been applied with a wide variety of subject matter and a broad spectrum of populations. This article briefly reviews the principles of cooperative learning, and describes how these principles were incorporated into a comprehensive set of cooperative learning activities for a CS1…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

Modelling is an inherent process for the construction and use of science concepts that mobilize diverse specific competences. The aims of this work are to put forward a means of evaluating modelling competences that is relevant for physics teaching and science education research and to identify the potentials and constraints in the development of…

Using data from the reading component of the Ontario Secondary School Literacy Test (N = 113,050), the effects of gender and curricular track for nine sub-scores of reading achievement were investigated. Only students indicating that they did not receive additional programming support were included in the analysis. Gender accounted for less than…

Monte Carlo results were used to evaluate procedures for discriminating between groups. A multiple testing version of Hotelling's T-squared and the Bonferroni procedure were most powerful for detecting at least one true difference, depending on conditions examined. A multiple Bonferroni procedure was superior in power for detecting all true…

The purpose of this study was to evaluate the quality of experimental research in counseling and counselor education published from 1976 through 1984. The focus of the study was the methodology and reporting of the research rather than its relevance. Time was the independent variable of interest and three 3-year spans were chosen for examination:…

The University of California's census survey of undergraduates, UCUES [University of California Undergraduate Experience Survey], presents an opportunity to measure both disciplinary and institutional differences in students' academic experience. Results from nearly 60,000 responses (38% response rate) from the 2006 administration found greater…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…