This comment discusses some issues about the use and reporting of experimental studies in education, illustrated by a recently published study that claimed (i) that an educational innovation was effective despite outcomes not reaching statistical significance, and (ii) that this refuted the findings of an earlier study. The two key issues raised…

D. W. Zimmerman argues that the interpretation by J. D. Gibbons and S. Chakraborti of recent simulation results and their recommendations are misleading and suggests use of an alternate test when homogeneity of variance and normality are violated. Gibbons and Chakraborti review their differences with Zimmerman's position. (SLD)