Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly common in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly com- mon in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

"What works" policies are the latest incarnation of best practices in educational research. Instituted by various organisations internationally, they define what kind of research counts as "evidence" for reform-oriented decision-making. While some countries rely on systematic analyses and meta-analyses, the U.S. favours primary…

Including all children in large-scale educational studies is a pressing concern. Omitting certain types of children from studies can lead to skewed findings that promote inaccuracies about learning levels or educational quality. Increasingly, assessments are a method for investigating the quality of education systems, but national assessments are…

Critically examining common statistical approaches and their strengths and weaknesses is an important step in advancing recreation and leisure sciences. To continue this critical examination and to inform methodological decision making, this study compared three approaches to determine how alternative approaches may result in contradictory…

The use of educational technology in K-12 classrooms has been gaining tremendous momentum across the country since the 1990s. Many school districts have been investing heavily in various types of technology, such as computers, mobile devices, internet access, and interactive whiteboards. Almost all public schools have access to the internet and…

The present review examines research on the effects of technology use on reading achievement in K-12 classrooms. Unlike previous reviews, this review applies consistent inclusion standards to focus on studies that met high methodological standards. In addition, methodological and substantive features of the studies are investigated to examine the…

This article suggests ways in which the consumer of educational research can critically evaluate research reports in terms of sample and methodology, design and statistical treatment, and results and interpretation. The reader is alerted to sources of deliberate and nondeliberate bias and to fallacious use and/or interpretation of statistics.…

This paper addresses several issues in quantitative research that educational researchers should examine with more care. While the purposes of experimentation is to determine causality, the study of causal relations is difficult and problematic. Computational and conceptual errors in statistical analysis seem limited only by the creativity of the…

Three topics within the domain of regression-based analyses of multilevel data from quasi-experiments and field studies in educational research and evaluation are presented. The paper begins with a discussion of the general question of choice of unit of analysis, or what may be the more appropriate question of choice of analytical model. It then…

A meta-analysis of outcomes from 32 studies investigating pretest effects was conducted. For all outcomes the average effect size was +.22, indicating an elevating effect of pretest on posttest. Duration of time between pre- and posttesting was also related to effect size. Researchers should continue to include pretest as a design variable.…

Identifies shortcomings of single equation models of educational achievement, including that they have omitted relevant variables. Considers three models of educational achievement--one using cross-sectional data; one using pre- and post measures of achievement; and one using more complete panel data. (Author/DB)

A research psychologist and education consultant offers school board members some principles for appraising statistics: (1) distinguish between rates and numbers; (2) distinguish between ranks and scores; (3) try to "look through" the pictorial representation of data; (4) double check the data for accuracy; and (5) consider the source of the data.…

Presents an assessment of the relative performance of public and private schools, based on data from the Educational Testing Service. Challenges the Coleman Report's assertion that private schools more closely approximate the common school egalitarian ideal and sever the connections between background characteristics and measured achievement. (SA)

This review of research on the social integration of children with disabilities in mainstreaming programs addresses the problems of generalizing findings to other groups of children, use of simplistic measuring techniques, limited evidence supporting the use of multivariate statistical procedures, and interpretation of treatment effects.…