Whether one should use null hypothesis testing, confidence intervals, and/or effect sizes is a source of continuing controversy in educational research. An alternative to testing for statistical significance, known as equivalence testing, is little used in educational research. Equivalence testing is useful in situations where the researcher…

This paper suggests that statistical significance testing and effect size are two sides of the same coin; they complement each other, but do not substitute for one another. Good research practice requires that both should be taken into consideration to make sound quantitative decisions. A Monte Carlo simulation experiment was conducted, and a…

Against an historical backdrop, this paper summarizes four uses of intraclass correlation of importance to contemporary researchers in the behavioral sciences. First, it shows how the intraclass correlation coefficient can be used to adjust confidence intervals for statistical significance testing when data are intracorrelated and the independence…

The program with extensive annotation is available in an unpublished dissertation (Schabert, 1970). (Authors)

Examines the influence of statistical significance on reviewers' recommendations for the acceptance or rejection of a manuscript for publication. Discusses the concept of power and the importance of effect size in the evaluation of research findings. (WAS)

An analytic procedure is presented which casts sequential moderator analysis in the role of a multivariate test of parallelism of regressions. The procedure addresses a test for comparing predictor-criterion relationships for one set of measurements or multiple predictors and repeated measurements on a criterion. (Author/PN)

Consulting editors (N=101) of the Journal of Counseling Psychology and the Journal of Consulting and Clinical Psychology evaluated three versions, differing only with regard to level of statistical significance, of a research manuscript. Statistically nonsignificant and approach significance versions were more likely to be recommended for…

Formulas for estimating the population measure of effect strength are based on the assumption that sample sizes are proportional to the sizes of their respective treatment populations. Because this assumption is frequently violated, a general method of estimating effect strength for the one-factor, fixed-effects design is presented. (Author/BW)

Discusses (1) the use of chi square significance tests in social science and educational literature; (2) chi square in relation to sample size; (3) field difficulties with chi square analysis as exemplified in Milwaukee County Juvenile Court data; and (4) alternative methods for using chi square in field research. (Author/GC)

Regions of significance in aptitude-by-treatment-interaction studies are examined by the traditional statistical approach and an alternative approach which integrates: (1) testing for the parallelism of two or more regression lines; (2) testing for their identity; and (3) Scheffe's theorem. (Author/RL)

Two alternative procedures are described for testing the significance of differences of group means. The first consists of a reduction in the critical value when comparing the largest and smallest means. The other alternative uses the unmodified range test without a preliminary F test. An example is provided. (Author/CTM)

A new coefficient--psi-star--is presented for measuring agreement on bidirectional response continua. The coefficient is designed to measure agreement in larger square contingency tables with even numbers of rows and columns. Advantages of the procedure are discussed. (SLD)

Simulation studies were used to explore the relationship between Type I error rates (statistical conclusion validity) and multiple testing in data sets exhibiting varying degrees of independence. Implications for reporting and interpreting educational data are discussed, and methods of determining or reducing Type I error incidence are presented.…

Use of the bootstrap method in a canonical correlation analysis to evaluate the replicability of a study's results is illustrated. More confidence may be vested in research results that replicate. (SLD)