Procedures are described for determining the statistical significance of a set of ratings made on bidirectional (B) scales. B and its statistical significance can be determined on samples of items or raters. The statistical significance of a mean of B values can be assessed by applying a normal approximation test. (Author/DWH)

The Galois-lattice is a graphic method for representing all possible developmental phases to reach a given total knowledge via different partial knowledge structures. Algorithms are proposed for incorporating statistical analysis into the Galois-lattice method. A comparison to the Rasch model and application for educational research are given. (BS)

Available approaches for determing significant differences between various groups are considered for use when the homogeneity of slopes precludes standard analysis of covariance. The advantages and statistical procedures for relating to a reference group are presented and criteria are suggested for choosing the best groups. (Author)

This article presents a system for avoiding Type I error increases when increasing the number of contrasts computed. Based on the Bonferroni inequality, the procedure corrects for the number of contrasts tested. Although conservative, the Bonferroni system is recommended for its flexibility, simplicity, and generality. (Author/BS)

While Bonferroni procedures control the risk of Type I errors, their cost is loss of power. Ordered Bonferroni procedures conserve power for more important tests while sacrificing power for less important tests. Both costs and benefits should be considered when choosing weights for individual tests and the overall level of Type I error protection.…

The effects of some restraints not included in the classical assumptions of the F- and H-Test (e.g., correlation of mean and sample size) were examined in a simulation design. Also simulated was a situation in which two assumptions were not met simultaneously. (Author/BW)

After presenting a general linear model as a framework for discussion, this paper reviews five methodology errors that occur in educational research: (1) the use of stepwise methods; (2) the failure to consider in result interpretation the context specificity of analytic weights (e.g., regression beta weights, factor pattern coefficients,…

This paper addresses the state of the art regarding the use of statistical significance tests (SSTs). How social science research will be conducted in the future is impacted directly by current debates regarding hypothesis testing. This paper: (1) briefly explicates the current debate on hypothesis testing; (2) reviews the newly published report…

This paper suggests that statistical significance testing and effect size are two sides of the same coin; they complement each other, but do not substitute for one another. Good research practice requires that both should be taken into consideration to make sound quantitative decisions. A Monte Carlo simulation experiment was conducted, and a…

Examines the influence of statistical significance on reviewers' recommendations for the acceptance or rejection of a manuscript for publication. Discusses the concept of power and the importance of effect size in the evaluation of research findings. (WAS)

An analytic procedure is presented which casts sequential moderator analysis in the role of a multivariate test of parallelism of regressions. The procedure addresses a test for comparing predictor-criterion relationships for one set of measurements or multiple predictors and repeated measurements on a criterion. (Author/PN)

Discusses (1) the use of chi square significance tests in social science and educational literature; (2) chi square in relation to sample size; (3) field difficulties with chi square analysis as exemplified in Milwaukee County Juvenile Court data; and (4) alternative methods for using chi square in field research. (Author/GC)

Use of the bootstrap method in a canonical correlation analysis to evaluate the replicability of a study's results is illustrated. More confidence may be vested in research results that replicate. (SLD)

Describes the utility of effect size reporting and reports on a study that reviewed articles in three quarterly gifted journals and 40 articles in journals not directly associated with gifted education, published over the last five years. Effect sizes were generally not included in research articles, with results consistent across journals.…

Underpowered studies persist in the psychological literature. This article examines reasons for their persistence and the effects on efforts to create a cumulative science. The "curse of multiplicities" plays a central role in the presentation. Most psychologists realize that testing multiple hypotheses in a single study affects the Type I error…