In educational effectiveness research, multilevel data analyses are often used because research units (most frequently, pupils or teachers) are studied that are nested in groups (schools and classes). This hierarchical data structure complicates designing the study because the structure has to be taken into account when approximating the accuracy…

A procedure is presented to transform an n-dimensional scatter diagram into a two-dimensional scatter diagram while preserving proximity relationships between points. This procedure can help in the presentation and interpretation of multivariate results. (Author/SLD)

Examination of the stochastics of moderated multiple regression (MMR) reveals that MMR is an appropriate technique when predictors are fixed variables and the distribution of errors is normal but is not appropriate when predictors are random variables and the joint distribution of criterion and predictor variables is multivariate normal. (SLD)

In the present study Monte Carlo methods were employed to evaluate the degree to which canonical function and structure coefficients may be differentially sensitive to sampling error. Sampling error influences were investigated across variations in variable and sample (n) sizes, and across variations in average within-set correlation sizes and in…

Calls attention to limitations and dangers in routine application of multivariate analysis of variance (MANOVA), describes some alternative procedures, and laments the necessarily pervasive character of the statistical problem. (Author)

The test proposed by Brien, Venables, and Mayo (1984), endorsed by Silver and Dunlap, and supported by computer software that they developed is not a proper test for multivariate independence. A revised appraisal is suggested for the Silver and Dunlap results. (SLD)

The need for using invariance procedures to establish the external validity or generalizability of statistical results has been well documented. Invariance analysis is a tool that can be used to establish confidence in the replicability of research findings. Several approaches to invariance analysis are available that are broadly applicable across…

C. L. Olson (1976, 1979) suggests the Pillai-Bartlett trace (V) as an omnibus multivariate analysis of variance (MANOVA) test statistic for its superior robustness to heterogeneous variances. J. Stevens (1979, 1980) contends that the robustness of V, Wilk's lambda (W) and the Hotelling-Lawley trace (T) are similar, and that their power functions…

Type I error rates of four multivariate tests (Pilai-Bartlett trace, Johansen's test, James' first-order test, and James' second-order test) were compared for heterogeneous covariance matrices in 360 simulated experiments. The superior performance of Johansen's test and James' second-order test is discussed. (SLD)

The present paper suggests that multivariate methods ought to be used more frequently in behavioral research and explores the potential consequences of failing to use multivariate methods when these methods are appropriate. The paper explores in detail two reasons why multivariate methods are usually vital. The first is that they limit the…

Meta-analytic methods were used to summarize results of Monte Carlo (MC) studies investigating the robustness of various statistical procedures for testing within-subjects effects in split-plot repeated measures designs. Through a literature review, accessible MC studies were identified, and characteristics (simulation factors) and outcomes (rates…