Research in fields other than education has found that studies with small sample sizes tend to have larger effect sizes than those with large samples. This article examines the relationship between sample size and effect size in education. It analyzes data from 185 studies of elementary and secondary mathematics programs that met the standards of…

Canonical correlation analysis is illustrated and three common fallacious interpretation practices are described. Simply, canonical correlation is an example of the bivariate case. Like all parametric methods, it involves the creation of synthetic scores for each person. It presumes at least two predictor variables and at least two criterion…

The minimum number of points required for continuous scaled variables before the Pearson product moment correlation coefficient (PPMCC) ceases to be an accurate estimate if their original correlation coefficient is five. Results also indicated that the PPMCC obtained by using transformed discrete ordinal-level variables tended to underestimate the…

If the factor loadings of a core set of variables (fitting the general factor model) are the same when analyzed alone, and when analyzed along with the rest of the variables in an infinite behavior domain, there is only one factor variable in the domain that is a possible factor variable of the core set. If the condition of consistency of factor…

The paper is a critique of the traditional mode of interpreting factor analyses; it is not a criticism of factor analysis per se. Instead, the author proposes a statistical procedure based upon stepwise regression (SRP). The traditional mode focuses on the largest factor loadings (FL). A factor is both described and named by these heavily weighted…

This paper points out the logical, theoretical, and statistical problems associated with the computation of the "pooled-within" correlation coefficient in partially segregated educational systems. (Author/LMO)

Meta-analysis has become an important supplement to traditional methods of research reviewing, although many problems must be addressed by the reviewer who carries out a meta-analysis. These problems include identifying and obtaining appropriate studies, extracting estimates of effect size from the studies, coding or classifying studies, analyzing…

Critics have occasionally asserted that the number of factors in the 16PF tests is too large. This study discusses factor-analytic methodology and reviews more than 50 studies in the field. It concludes that the number of important primaries encapsulated in the series is no fewer than the stated number. (Author/JAZ)

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

The merits of the multilevel model for educational research and its uses for school effectiveness research are considered. The main goal of the paper is to establish what intelligent applications of multilevel models can do, helping researchers decide what they must do to make a rational choice between models. Multilevel models are random line…

Statistical significance is misused in educational and psychological research when it is applied as a method to establish the reliability of research results. Other techniques have been developed which can be correctly utilized to establish the generalizability of findings. Methods that do provide such estimates are known as invariance or…

This monograph covers the theory, application, and interpretation of both descriptive and inferential statistical techniques in institutional research. Each chapter opens with a hypothetical case study, which is used to illustrate the application of one or more statistical procedures to typical research questions. Chapter 2 covers the comparison…