J. Frass and I. Newman (2000) proposed a hypothesis testing procedure that incorporated the following three key elements: (1) the establishment of a practical significance value; (2) the construction of a non-nil null hypothesis that incorporated the practical significance value; and (3) statistical testing of the non-nil null hypothesis with a…

This paper presents a testing procedure that incorporates three key elements. The first element is the use of non-nil null hypotheses. The second element is the determination of a practically significant level that is incorporated into the corresponding non-nil null hypothesis. The third element is the use of a randomization test to statistically…

The increased interest in reporting effect sizes means that it is necessary to consider what should be included in a primer on effect sizes. A review of papers on effect sizes and commonly repeated statistical analyses suggests that it is important to discuss effect sizes relative to bivariate correlation, t-tests, analysis of variance/covariance,…

Over the last few years, there has been evolution, although not a linear one, that has progressed from an emphasis on statistical significance to an emphasis on effect size to an emphasis on both of these concepts to what is believed to be a pragmatic emphasis on replicability. This paper presented two methods of estimating a study's replicability…

The Pearson chi-square test can be useful in situations in which the researcher wishes to compare observed versus expected frequencies in categories, or cells, or a contingency table. Although these tests can be useful, various problems associated with their use and interpretation are common. First, the chi-square test is often the result of weak…

The purpose of this paper is to illustrate how displaying disattenuated correlation coefficients along with their unadjusted counterparts will allow the reader to assess the impact of unreliability on each bivariate relationship. The paper also demonstrates how a proposed new "what if reliability" analysis can complement the conventional null…

The tests discussed provide a relatively wide variety of inference techniques which may be applied to "koppa". Each of the techniques may be used to construct confidence intervals, and one specific equation provides a simultaneous test of zero values for two koppas when applied properly. (NE)

A more general method for calculating the Kappa measure of nominal rating agreement among multiple raters is presented. It can be used across a broad range of rating designs, including those in which raters vary with respect to their base rates and how many subjects they rate in common. (Author/BW)

Post hoc multiple comparison procedures useful in assessing differences in population variability are formulated for three nonparametric alternatives to the parametric Bartlett test. The three nonparametric tests are the generalized Puri K-sample extensions of the Siegel-Tukey, mood, and Klotz tests. (Author/CTM)

Provides tables of critical values for determining statistically significant discrepancies between Wechsler Verbal/Performance IQ and Wechsler Individual Achievement Test subtests and composite scores based on predicted-achievement method. Recommends that tables be used when statistically significant and diagnostically meaningful Verbal…

Provides an overall test statistic to evaluate significance that yields 100% (1-alpha) confidence intervals for all linear combinations of effect sizes, shows how the stepdown Finite Intersection Test (N. Timm, 1995) may be used to test whether effect sizes are simultaneously different from zero, and illustrates the procedure. (SLD)

Presents an adaptive approach to multiple significance testing based on the procedure of Y. Benjamini and Y. Hochberg (1995) that first estimates the number of true null hypotheses and then uses that estimate in the Benjamini and Hochberg procedure. Uses the new procedure in examples from educational and behavioral studies and shows its control of…

Meares-Irlen Syndrome (MIS) is characterised by symptoms of visual stress and visual perceptual distortions that are alleviated by using individually prescribed coloured filters. Coloured overlays (sheets of transparent plastic that are placed upon the page) are used to screen for the condition. MIS is diagnosed on the basis of either the…