Network meta-analysis (NMA) incorporates all available evidence into a general statistical framework for comparing multiple treatments. Standard NMAs make three major assumptions, namely homogeneity, similarity, and consistency, and violating these assumptions threatens an NMA's validity. In this article, we suggest a graphical approach to…

Meta-analysis is a statistical method that is increasingly utilized to combine and compare the results of previous primary studies. However, because of the lack of comprehensive guidelines for how to use meta-analysis, many meta-analysis studies have failed to consider important aspects, such as statistical programs, power analysis, publication…

This study replicates and extends a 2004 content analysis of three major higher education journals. The original study examined the methodological characteristics of all published research in these journals from 1996 to 2000, recommending that higher education programs adjust their graduate training to better match the heavily quantitative and…

The validity and reliability of the Technological Pedagogical Content Knowledge (TPACK) framework to measure the extent to which teachers can teach with technology, hinges on the ability to aggregate results across empirical studies. We synthesized mean difference effect sizes resulting from university classroom studies, which used a survey of…

Many of the methodological criticisms of the National Early Literacy Panel (NELP) report presented in this special issue of "Educational Researcher" are not specific to the NELP report but are in fact broad criticisms of much of the quantitative research on early literacy. This rejoinder demonstrates that these criticisms are off target and are…

The purpose of the present study is to provide a historical account and metasynthesis of which statistical techniques are most frequently used in the fields of education and psychology. Six articles reviewing the "American Educational Research Journal" from 1969 to 1997 and five articles reviewing the psychological literature from 1948 to 2001…

To assess research methods and analysis of statistical techniques employed by educational researchers, this study surveyed unpublished doctoral dissertation from 2003 to 2007. Frequently used research methods consisted of experimental research; a survey; a correlational study; and a case study. Descriptive statistics, t-test, ANOVA, factor…

This "Research Commentary" addresses the quality of statistical research in mathematics education. To do so, 10 years of Journal for Research in Mathematics Education (JRME) articles were analyzed on the basis of criteria suggested by the American Educational Research Association, American Psychological Association, and National Council for…

In meta-analysis, it is common to have dependent effect sizes, such as several effect sizes from the same sample but measured at different times. Cheung and Chan proposed the adjusted-individual and adjusted-weighted procedures to estimate the degree of dependence and incorporate this estimate in the meta-analysis. The present study extends the…

The purpose of this paper was to research published validity reports of the Multiple Assessment and Program Services (MAPS) Test and to conduct quantitative analysis on the validity coefficients from the MAPS reports to determine the generalizability of the results and to identify which variables in the reports impact these coefficients. The…

The random variable p and its functions figure in several "tests of combined significance," meta-analysis summaries based on sample significance values, and ps have been used singly, as well as in other tests for evaluating the outcomes of individual research studies. In this work, asymptotic distributions of the sample one-sided…

Approximations to the distribution of a common form of effect size are presented. Single sample tests, confidence interval formulation, tests of homogeneity, and pooling procedures are based on these approximations. Caveats are presented concerning statistical procedures as applied to sample effect sizes commonly used in meta-analysis. (Author)

Formulas for estimating cross-validated hit-rates, the number of correct classifications into an a priori grouping structure, were examined. The following mathematical formulas were compared: McLachlan's formula estimator, two Snappin and Knoke smoothed formula estimators, and the analytic leave-one-out estimator. The R method was included as a…

Rosenthan's (1979) concept of fail-safe N has thus far been applied to probability levels exclusively. This note introduces a fail-safe N for effect size. (Author)

Basic rules are suggested to replace the signed coefficient rule to infer the form of moderator effects in terms of slopes of regression lines. Steps are provided to interpret the form of moderator effects that can be achieved using only the regression coefficients of the predictor variable and interaction term. (SLD)