This paper compares the use of confidence intervals (CIs) and a sensitivity analysis called the number needed to disturb (NNTD), in the analysis of research findings expressed as 'effect' sizes. Using 1,000 simulations of randomised trials with up to 1,000 cases in each, the paper shows that both approaches are very similar in outcomes, and each…

On the one hand, a growing amount of research discusses support for improving online collaborative learning quality, and many indicators are focused to assess its success. On the other hand, thinkLets for designing reputable and valuable collaborative processes have been developed for more than ten years. However, few studies try to apply…

Many education research studies employ small samples, which in turn lowers statistical power. We re-analyzed the results of a meta-analysis of simulation-based education to determine study power across a range of effect sizes, and the smallest effect that could be plausibly excluded. We systematically searched multiple databases through May 2011,…

We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant…

This study examined the relationship between human patient simulation (HPS), critical thinking skills, and knowledge acquisition after HPS was integrated across the curriculum of an associate degree nursing program to determine if differences existed in critical thinking and knowledge of students based on the fidelity of HPS used and amount of…

A reexamination of the traditional instruction of introductory computer science (CS) courses is becoming a necessity. Introductory CS courses tend to have high attrition rates and low success rates. In many universities, the CS department suffered from low enrollment for several years compared to other majors. Multiple studies have linked these…

Two strategies, derived from J. P. Schaffer (1986), were compared as tests of significance for a complete set of planned orthogonal contrasts. The procedures both maintain an experimentwise error rate at or below alpha, but differ in the manner in which they test the contrast with the largest observed difference. One approach proceeds directly to…

Five methods for testing the hypothesis of independence between two sets of variates were compared through simulation. Results indicate that two new methods, based on robust measures reflecting the linear association between two random variables, provide reasonably accurate control over Type I errors. Drawbacks to rank-based methods are discussed.…

Details of a reasonably precise normalization technique for coefficient alpha are outlined, along with methods for estimating the variance of the normalized statistic. These procedures lead to the K-sample significance test. (RC)

Statistics used to estimate the population correlation ratio were reviewed and evaluated. The sampling distributions of Kelly's and Hays' statistics were studied empirically by computer simulation within the context of a three level one-way fixed effects analysis of variance design. (Author/RC)

Stability of Type I error rates and power are investigated for three forms of the Box test and two forms of the jackknife test with equal and unequal sample sizes under conditions of normality and nonnormality. The Box test is shown to be robust to violations of the assumption of normality when sampling is from leptokurtic populations. The…

The intent of the study was to determine the extent to which test statistics computed by the unweighted means analysis are F-distributed. Applicability criteria were sought in terms of the number of factor levels and the degree to which cell frequencies differ. The unweighted means analysis, a frequently used approximate analysis, was contrasted…

The capability was studied of each of three models for producing indices that will reproduce school effectiveness rankings established a priori through simulation. The models used were a within-group regression technique, a regression model using individual scores, and a regression model using means. Data for 54 hypothetical schools on input, SES,…

The four main approaches to measuring treatment effects in schools; raw gain, residual gain, covariance, and true scores; were compared. A simulation study showed true score analysis produced a large number of Type-I errors. When corrected for this error, this method showed the least power of the four. This outcome was clearly the result of the…