This dissertation consists of three manuscripts. The manuscripts contribute to a budding "methodological reform" currently taking place in quantitative second-language (L2) research. In the first manuscript, the researcher describes an empirical investigation on the application of two well-known effect size estimators, eta-squared (eta…

Planned missing data designs allow researchers to increase the amount and quality of data collected in a single study. Unfortunately, the effect of planned missing data designs on power is not straightforward. Under certain conditions using a planned missing design will increase power, whereas in other situations using a planned missing design…

The subject of research methods is often unknown, foreboding, and unappealing to undergraduate communication majors. Thus, in the research methods course, two ways to overcome such issues and achieve learning are by: (1) making the unfamiliar more familiar and accessible; and (2) placing abstract knowledge in its useful real-world context. Making…

We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

In 4 studies, the authors examined the hypothesis that the structure of the informational environment makes small samples more informative than large ones for drawing inferences about population correlations. The specific purpose of the studies was to test predictions arising from the signal detection simulations of R. B. Anderson, M. E. Doherty,…

Two strategies, derived from J. P. Schaffer (1986), were compared as tests of significance for a complete set of planned orthogonal contrasts. The procedures both maintain an experimentwise error rate at or below alpha, but differ in the manner in which they test the contrast with the largest observed difference. One approach proceeds directly to…

Multiple-hypothesis testing in the context of a correlation matrix is used to compare the statistical power of the original Bonferroni with six modified Bonferroni procedures that control the overall Type I error rate. Three definitions of statistical power are considered: (1) the ability to detect at least one true relationship; (2) the ability…

This simple method for simulating the Central Limit Theorem with students in a beginning nonmajor statistics class requires students to use dice to simulate drawing samples from a discrete uniform distribution. On a chalkboard, the distribution of sample means is superimposed on a graph of the discrete uniform distribution to provide visual…

A 2-to-the-kth-power mirror-image design is defined as one in which repeated observations of subjects occurs among the levels of a usual 2-to-the-kth-power design, but there is the restriction that no subject may receive a given level of any factor more than once. Such a restriction might arise, for example, if a subject's response is expected to…

This study developed and investigated an empirical sampling distribution of the congruence coefficient. The effects of sample size, number of variables, and population value of the congruence coefficient on the sampling distribution of the congruence coefficient were examined. Sample data were generated on the basis of the common factor model and…

Problems involved in providing practical research experience in research methods courses are discussed. The two points in the research process where time is most critical are selecting measures and data collection. This paper suggests using a data base from previous research and having students conduct simulated studies based on randomly selected…

In order for research on the educational utility of simultation games to advance, there must be some stipulation of a set of significant variables. This, in turn, requires the building of testable theoretical models and the formulation of strategic propositions to test their validity. An example of the process involved is as follows. Focusing upon…

Describes a study which used a graduate-level business game to examine consequences of objectively determined fit between managers' specialized competence and their functional roles in terms of individual and group performance. The game simulates a work environment of top-level management in industrial firms with responsibility for making…

This discussion of research methodologies and performance prediction in business simulations describes a study of undergraduates that considered time in the prediction of simulation performance, and explored how relationships between performance and its antecedents vary over the simulation's duration. Hypotheses tested are explained and results of…