It is recommended that levels of analysis of variance (ANOVA) designs be applied to carrier variables to help overcome the lack of unambiguously generablizable results in many applied experiments. (Author)

Sections of this paper are: basic framework for the review; fundamentals of choosing contrasts in multivariate analysis of variance; principles and procedures for orthogonal and in nonorthogonal MANOVA; general problems and principles in the analysis of multivariate dependent variables. References. (Author/VW)

Analysis of 19 studies using omnibus analysis of variance (ANOVA) F-tests resulted in reasons for replacing ANOVA with focused hypothesis testing, which is easy to compile and understand; is flexible; enables trend analysis, determination of confidence intervals, adjustments for violated assumptions, and control of Type 1 errors; makes effect size…

As an extension of B. Thompson's 1998 invited address to the American Educational Research Association, this paper cites two additional common faux pas in research methodology and explores some research issues for the future. These two errors in methodology are the use of univariate analyses in the presence of multiple outcome variables (with the…

This report presents the problem and a solution to the treatment of students by age interactions. It considers the plight of an educational researcher who wishes to demonstrate that a particular treatment effect changes from age to age. In analysis of variance language, he is seeking a treatment by age interaction. The report presents a rationale…

This interim report is concerned with the analysis of educational experiments and quasiexperiments where alternative teaching methods are applied to intact classes or where alternative programs are set up in samples of schools or communities. Generally, such studies have used the class, the school, or the community as the unit of sampling with the…

In educational research, nonessential factors are commonly ignored and when accounted for, they are often treated statistically as fixed effects. Yet many researchers in these situations generalize their findings beyond the specific levels selected; however, the analyses may require treating the factor as a random effect. Such inappropriate…

The present paper contributes to research methodology as practiced in the field by providing practitioners with a concise statement of the problems in analyzing unbalanced designs, and by clarifying the conditions under which the analysis alternatives are most appropriate. The purposes of the present paper are: (1) to examine the analysis…

Application of the Kruskal-Wallis test to survey research problems is discussed as an alternative for the business education researcher in testing questionnaire response differences among three or more independent groups. Problem illustrations and a computer program are included. (MF)

Cut-and-try techniques that point to appropriate transformations of variables and to the selection of sets of variables for an equation that may improve understanding of a social process are illustrated. (MV)

The degree to which the chosen units of analysis are likely to produce spurious findings in staged combinations of multiple linear regression procedures are examined. The effects of grouping variables (e.g., classroom, school, and school district) on Procedures such as Coleman's semipartial regression and Mayeske's commonalities, in light of…

This paper discusses the problems of gathering and analyzing data on classroom behaviors. The difficulties involved in using the common pretest-posttest experimental design are described. To grapple with these problems, a study was conducted on the effect of environmental changes on student behavior, employing a time-series design and time-series…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

Examines unresolved problems and future prospects for research concerning school quality. Asserts that the proportion of variance among factors such as, school system, school type, grade levels, individual schools, and learning groups makes consideration of the schools as a homogenous whole doubtful. Includes numerous statistical tables and…