Most biological scientists conduct experiments to look for effects, and test the results statistically. One of the commonly used test is Student's t test. However, this test concentrates on a very limited question. The authors assume that there is no effect in the experiment, and then estimate the possibility that they could have obtained these…

This report presents guidelines for addressing the multiple comparisons problem in impact evaluations in the education area. The problem occurs due to the large number of hypothesis tests that are typically conducted across outcomes and subgroups in these studies, which can lead to spurious statistically significant impact findings. The…

Statistical significance is not a sufficient condition for claiming a hypothesis has been supported. Constructive replications are more important. Statistically significant results may be meaningless while a sequence of nonsignificant results may be quite important. Gives advice on how to overcome some limitations of classifical statistical…