Correlation matrices and standard deviations are the building blocks of many of the commonly conducted analyses in published research, and AERA and APA reporting standards recommend their inclusion when reporting research results. The authors argue that the inclusion of correlation/covariance matrices, standard deviations, and means can enhance…

Multiple regression analysis is frequently being employed in experimental and non-experimental research. However, when data include predictor variables that are correlated, some regression results can become difficult to interpret. This paper presents a study to provide a demonstration that structure coefficients may be useful in these cases.…

Conventional statistical significance tests do not inform the researcher regarding the likelihood that results will replicate. One strategy for evaluating result replication is to use a "bootstrap" resampling of a study's data so that the stability of results across numerous configurations of the subjects can be explored. This paper…

Selected methods for evaluating the stability of research results empirically are described, especially with regard to multivariate analysis. It is critically important to evaluate the influences of sampling error on obtained results; statistical significance testing does not inform judgment regarding the probable replicability or the sampling…

Dissertations are the cumulative, tangible "best evidence" of interests of doctoral faculty and students in serious and incisive scholarship. Thus, dissertations are thoroughly studied by the program review teams periodically hired by boards of higher education in most states. The present paper explores seven errors in quantitative…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

The present paper suggests that multivariate methods ought to be used more frequently in behavioral research and explores the potential consequences of failing to use multivariate methods when these methods are appropriate. The paper explores in detail two reasons why multivariate methods are usually vital. The first is that they limit the…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…

Dissertations are an important component of the effort to generate knowledge. Thus, dissertation quality may be seen by accreditation and coordinating-board reviewers as a noteworthy reflection on the quality of doctoral programs themselves. The present study reviews methodological errors within Ph.D. dissertations. The illustrative errors are…