Common sense is a dynamic concept and it is natural that our (statistical) common sense lags behind the development of statistical science. What is not so easy to understand is why common sense lags behind as much as it does. We conduct a survey among Japanese students and provide examples and tentative explanations of a number of statistical…

In late November 2020, there was a flurry of media coverage of two companies' claims of 95% efficacy rates of newly developed COVID-19 vaccines, but information about the confidence interval was not reported. This paper presents a way of teaching the concept of hypothesis testing and the construction of confidence intervals using numbers announced…

Students studying statistics often misunderstand what statistics represent. Some of the most well-known misunderstandings of statistics revolve around null hypothesis significance testing. One pervasive misunderstanding is that the calculated p-value represents the probability that the null hypothesis is true, and that if p < 0.05, there is…

A design experiment where students in Grade 5 (11-12 years old) play the Color Run game constitutes the context for investigating how students can be introduced to informal hypothesis testing. The result outlines a three-step hypothetical learning trajectory on informal hypothesis testing. In the first step, students came to favor sample space…

A modified and improved inductive inferential approach to evaluate item discriminations in a conditional maximum likelihood and Rasch modeling framework is suggested. The new approach involves the derivation of four hypothesis tests. It implies a linear restriction of the assumed set of probability distributions in the classical approach that…

This article reports on a study in which third-grade students (8-9 years) were given a degree of agency in conducting chance experiments and representing the outcomes. Students chose their own samples of 12 coloured counters, ensuring all colours were represented. They predicted the outcomes of item selection, tested their predictions, explained…

The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Whether supervision of doctoral students is best pursued individually or collectively is a recurring but unresolved question in debates on higher education. The rarity of longitudinal data and the common usage of qualitative methods to analyse a limited number of cases have left the effectiveness of either model largely untested. To assist with…

It is now widely accepted that the standard inferential toolkit used by the scientific research community--null-hypothesis significance testing (NHST)--is not fit for purpose. Yet despite the threat posed to the scientific enterprise, there is no agreement concerning alternative approaches for evidence assessment. This lack of consensus reflects…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

Purpose: This article focuses on toddlers' revisions of the sentence subject and tests the hypothesis that subject diversity (i.e., the number of different subjects produced) increases the probability of subject revision. Method: One-hour language samples were collected from 61 children (32 girls) at 27 months. Spontaneously produced, active…

Artificial intelligence-enabled adaptive learning systems (AI-ALS) are increasingly being deployed in education to enhance the learning needs of students. However, educational stakeholders are required by policy-makers to conduct an independent evaluation of the AI-ALS using a small sample size in a pilot study, before that AI-ALS can be approved…

There is a wealth of evidence that people's reasoning is influenced by explanatory considerations. Little is known, however, about the exact form this influence takes, for instance about whether the influence is unsystematic or because of people's following some rule. Three experiments investigate the descriptive adequacy of a precise proposal to…

This study examines informal hypothesis testing in the context of drawing inferences of underlying probability distributions. Through a small-scale teaching experiment of three lessons, the study explores how fifth-grade students distinguish a non-uniform probability distribution from uniform probability distributions in a data-rich learning…

While interest in Bayesian statistics has been growing in statistics education, the treatment of the topic is still inadequate in both textbooks and the classroom. Because so many fields of study lead to careers that involve a decision-making process requiring an understanding of Bayesian methods, it is becoming increasingly clear that Bayesian…