Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

In August 2015, in an article entitled "Estimating the Reproducibility of Psychology Science," the journal "Science" reported the findings of a comprehensive collaboration of social scientist researchers, collectively described as the "Open Science Collaboration" (OSC), who replicated the findings of 100 experiments…

This chapter introduces three applications of Bayesian inference to common and novel issues in second language research. After a review of the critiques of conventional hypothesis testing, our focus centers on ways Bayesian inference can be used for dealing with missing data, for testing theory-driven substantive hypotheses without a default null…

This article, written jointly by a mathematician and a barrister, looks at some of the statistical issues raised by court cases based on fraud involving chip and PIN cards. It provides examples and insights that statistics teachers should find helpful. (Contains 4 tables and 1 figure.)

In this article, the authors show how students can form familiar geometric figures on the calculator keypad and generate numbers that are all divisible by a common number. Students are intrigued by the results and want to know "why it works". The activities can be presented and students given an extended amount of time to think about…

This paper describes three spreadsheet exercises demonstrating the nature and frequency of type I errors using random number generation. The exercises are designed specifically to address issues related to testing multiple relations using correlation (Demonstration I), t tests varying in sample size (Demonstration II) and multiple comparisons…

The authors describe a collection of dynamic interactive simulations for teaching and learning most of the important ideas and techniques of introductory statistics and probability. The modules cover such topics as randomness, simulations of probability experiments such as coin flipping, dice rolling and general binomial experiments, a simulation…

The paper presents a characterisation about argumentation and proof in mathematics. On the basis of contemporary linguistic theories, the hypothesis that proof is a special case of argumentation is put forward and Toulmin's model is proposed as a methodological tool to compare them. This model can be used to detect and analyse the structure of an…

Implicit in the work of S. Huck and H. Sandler (1979) is the idea that the concept "rival hypotheses" refers to some kind of alternative explanation. Rather than being threats to internal validity, rival hypotheses, in their view, are interpretations that differ from those of the researcher. This paper broadens the idea to include any…

This article describes the history, evidence warrants, and evolution of the Center for Research on Evaluation, Standards, and Student Testing's (CRESST) model-based assessments. It considers alternative interpretations of scientific or practical models and illustrates how model-based assessment addresses both definitions. The components of the…

Both science itself, and the human culture of which it is a part, would benefit from a story of science that encourages wider engagement with and participation in the processes of scientific exploration. Such a story, based on a close analysis of scientific method, is presented here. It is the story of science as story telling and story revising.…

Science teachers and science textbooks commonly introduce students to the scientific method in elementary and junior high school, but the study of scientific method and philosophy can be a life-long endeavor. This essay concentrates on a particular aspect of the scientific method--the testing of hypotheses. Concepts of hypothesis testing have…

Compares the perceptions of Malaysians and Australians for four Web site design characteristics--atmospherics, news stories, signs, and products and services--as part of the integrated Internet marketing model. Hypothesizes that the predominant culture is not generalized to another culture, discusses validity and reliability, and suggest further…