A dialog between two fictional teachers provides some basic examples of how research that uses approved methodology may provide results that are significant statistically but not significant practically. (PGD)

The second half of a dialogue between two fictional teachers examines the significance of statistical significance in research and considers the factors affecting the extent to which research results provide important or useful information. (PGD)

Although the primary responsibility rests with the authors of articles reporting nonsignificant results to demonstrate the worth of the results by discussing the power of the tests, consumers should be prepared to conduct their own power analyses. This article demonstrates the use of power analysis for the interpretation of nonsignificant…

An explanation of the misuse of statistical significance testing and the true meaning of "significance" is offered. Literature about the criticism of current practices of researchers and publications is reviewed in the context of tests of significance. The problem under consideration occurs when researchers attempt to do more than just establish…

In the educational research literature alpha, the a priori level of significance, and p, the a posteriori probability of obtaining a test statistic of at least a certain value when the null hypothesis is true, are often confused. Explanations for this confusion are offered. Paradoxically, alpha retains a prominent place in textbook discussions of…

The high incidence of reported posttraumatic stress disorder (PTSD) among Vietnam veterans has prompted researchers to search for reliable assessment and treatment procedures for this disorder. Although some encouraging preliminary data on the use of the Minnesota Multiphasic Personality Inventory (MMPI) have been obtained, it is uncertain if this…

Concerned with imprecision in researchers' use of the word, "interpretive," this report draws from the work of Max Weber to describe the characteristics of an interpretive science of organizational communication and then briefly lists some advantages of following the interpretive approach. First examining the role of subjective meaning…

Theories employed to explain regularities in social behavior often contain explicit or implicit reference to the presence of nonlinear and/or nonadditive (i.e., multiplicative) relationships among germane variables. While such nonadditive features are theoretically important, the inclusion of quadratic or multiplicative terms in structural…

Two basic methods exist for drawing probability samples to be used in telephone surveys: directory sampling (from alphabetical or street directories) and random digit dialing (RDD). RDD includes unlisted numbers, whereas directory sampling includes only listed numbers. The goal of this paper is to estimate the effect of failure to include…

Arguing that reliable and valid dropout rate estimates are prerequisite to establishment of causal factors and intervention programs, this article examines differences in definitions of dropouts, computational methods, and the complexities in defining cohorts, as well as the importance of sample attrition. Several sources of error are discussed.…

Criticizes methodological tendencies of economics and sociological researchers who do not ask "how large is large?" Reliance on statistical significance and existence theorems shows the limits of formalistic rather than humanistic research approaches. Argues that serious scholars develop whole arguments and understand the rhetoric of…

The general goal of this paper is to help researchers conduct appropriately designed goodness of fit studies for item response model applications. The specific purposes are to describe: (1) an up-to-date set of promising and useful methods for addressing a variety of goodness of fit questions; and (2) current research studies to advance this set…

Political communication researchers recently have emphasized conditional relationships as crucial to specifying and understanding the effects of the mass media. In many cases, however, researchers will not predict which variables will modify the form or existence of media effects. They therefore will not include measures of the conditional…

Hypothetical data sets are used to demonstrate how canonical correlation methods subsume other commonly utilized parametric methods. Analysis of variance, analysis of covariance, multiple analysis of variance, and multiple analysis of covariance are heavily used by educational researchers. It is concluded that researchers would do well to consider…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…