The use of and emphasis on statistical significance testing has pervaded educational and behavioral research for many decades in spite of criticism by prominent researchers in this field. Much of the controversy is caused by lack of understanding or misinterpretations. This paper reviews criticisms of statistical significance testing and discusses…

A national survey of a stratified random sample of members of the American Educational Research Association was undertaken to explore perceptions of contemporary statistical issues, and especially of statistical significance tests. The 225 actual respondents were found to be reasonably representative of the population from which the sample was…

See EJ 041 277 for original article. (DG)

Twelve multiple comparison tests, both simultaneous and sequential, are described, analyzed, and evaluated. Overall recommendations are presented in a flow-diagram. (DG)

This nonparametric analysis of variance program includes the Kruskal-Wallis, Friedman, and Cochran methods. (DG)

The statistical power of nine k-sample tests against ordered location alternatives under completely randomized designs are investigated. The results are intended to aid researchers in selecting appropriate statistical procedures. (Author/JKS)

An alternative analysis of the two-group single response variable design is proposed. It involves the classification of experimental units to populations represented by the two groups. Three real data sets are provided to illustrate the utility of the classification analysis. A table of sample sizes required for the analysis is presented.…

To determine the effect of violating the assumption of homogeneity of covariance for the Tukey Wholly Significant Difference (WSD) test, Monte Carlo simulations varied the number of treatment groups, sample size, and degree of covariance heterogeneity. As covariance heterogeneity was increased, the empirical significance levels increased beyond…

This paper reviews the distinctions between classical and partial eta square and derives a formula for use in those complex analysis of variance designs in which the investigator desires a measure of classical eta square and has access only to the F-tests and relevant degrees of freedom. (Author/BW)

Theta is a statistic which measures the degree to which a designated pattern successfully partitions a matrix of pre- and post-treatment ratings into regions typical of each of two treatments. In this paper, theta is extended to multivariate and multigroup cases. (Author/BW)

Reexamines the article by Atkinson, Furlong, and Wampold (1982) and questions their conclusion that reviewers were biased toward statistically significant results. A statistical power analysis shows the power of their bogus study was low. Low power in a study reporting nonsignificant findings is a valid reason for recommending not to publish.…

The need for multiple comparison procedures for repeated measures means employing a pooled estimate of error variance to conform to the sphericity assumptions of the design in order to provide a valid test is discussed. An alternative approach which does not require this assumption is presented. (Author/JKS)