The binomial effect size display (BESD) displays the change in success rate attributable to a treatment procedure. It is readily understandable, applicable in varied contexts, and conveniently computed. (Author/GK)

Various indices for measuring agreement among several raters on the presence or absence of a trait can be interpreted as intraclass correlation coefficients. Such a reformulation clarifies the relationships among the measures, simplifies the computations involved, and permits simple significance tests to be carried out. An illustrative example is…

The contribution of individual variables to overall multivariate significance in a multivariate analysis of variance (MANOVA) is investigated using a combination of canonical discriminant analysis and Roy-Bose simultaneous confidence intervals. Difficulties with this procedure are discussed, and its advantages are illustrated using examples based…

The Galois-lattice is a graphic method for representing all possible developmental phases to reach a given total knowledge via different partial knowledge structures. Algorithms are proposed for incorporating statistical analysis into the Galois-lattice method. A comparison to the Rasch model and application for educational research are given. (BS)

An overview of the state of the art in psychological research is presented, with an emphasis on the attention given to effect sizes. The acceptance of small effect sizes for biomedical research is contrasted with the rejection of similar effect sizes for psychological research. The Binomial Effect Size Display is used to depict the practical…

The interpretation of significant left-tailed analysis of variance (ANOVA) F-ratios is supported by considering the case of a fixed effects ANOVA model. The conclusions of this case are generalizable to other standard ANOVA models. (Author/PN)

Counters arguments of Donald N. McClosky on formalism in the social sciences and claims he fails to identify important arguments that justify the practices he criticizes. Agrees that, although exposing accepted methods to critical examination is useful, this broad attack implies the rejection of good social science as well as bad. (NL)

This paper presents an index of goodness-of-fit for comparing m models over n trials. The index allows for differentiated weighting of the trials as to their importance in the comparison of the models. Several possible weighting schemes are suggested and the conditions on the weights which assure asymptotic normality of the index distribution are…

The purpose of this paper is to demonstrate how multiple linear regression provides a viable statistical methodology for dealing with meta-analysis in general, and specifically with the issues of nonindependence and design complexity, such as multiple treatments. Since the F-test and t-test are special cases of the general linear model,…

Faced with a nonstandard, complicated practical problem in statistical inference, the applied statistician sometimes must use asymptotic approximations in order to compute standard errors and confidence intervals and to test hypotheses. This usually requires that he derive formulas for one or more asymptotic sampling variances (and covariances)…

Practical formulas for several analysis of variance (ANOVA) designs and models are presented which make it possible for readers to compute strength of association measures without the use of complete ANOVA tables. (Author/PN)

Refutes Peter Mueser's criticisms of the author's position on formalistic research approaches. Restates that statistical significance is virtually useless. Claims mathematical economists take their intellectual positions from mathematics departments bringing irrelevant intellectual values into economics. (NL)

Some of the methods originally used to find relationships between reliability and power associated with a single measurement are extended to difference scores. Results, based on explicit power calculations, show that augmenting the reliability of measurement by reducing error score variance can make significance tests of difference more powerful.…

Statistical significance is often inappropriately equated with evaluating result importance and evaluating result replicability, even though these are three somewhat different issues. The prudent researcher must separately assess each of these elements of the "research triumvirate" by using different methods. This paper focuses on two…