Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

In this paper, we explore the role that examples play as mathematicians formulate conjectures, and we describe and exemplify one particular example-related activity that we observed in interviews with thirteen mathematicians. During our interviews, mathematicians productively used examples as they formulated conjectures, particularly by creating…

Research studies in Educational Data Mining (EDM) often involve several variables related to student learning activities. As such, it may be necessary to run multiple statistical tests simultaneously, thereby leading to the problem of multiple comparisons. The Benjamini-Hochberg (BH) procedure is commonly used in EDM research to address this…

The aim of this study is to characterize ways of reasoning and arguing that first year university mathematics students exhibit in problem-solving activities from a course that emphasizes the importance of formulating conjectures and the search for different ways to support or validate them. The use of a Dynamic Geometry System in the…

The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

Here, we present a strong test of the hypothesis that sacrificial moral dilemmas are solved using the same value-based decision mechanism that operates on decisions concerning economic goods. To test this hypothesis, we developed Psychological Value Theory. Psychological Value Theory is an expansion and generalization of Cohen and Ahn's (2016)…

In August 2015, in an article entitled "Estimating the Reproducibility of Psychology Science," the journal "Science" reported the findings of a comprehensive collaboration of social scientist researchers, collectively described as the "Open Science Collaboration" (OSC), who replicated the findings of 100 experiments…

The purposes of this study are to (1) examine the factorial validity of Schein's career anchors orientation inventory (COI), comparing the original eight-factor model with an alternative nine-factor model, (2) examine the cross-cultural invariance of the COI and its factor structure across two countries, (3) investigate whether core…

The validation model of causal bridging inferences proposed by Singer and colleagues (e.g., Singer in "Can J Exp Psychol," 47(2):340-359, 1993) claims that before a causal bridging inference is accepted, it must be validated by existing knowledge. For example, to understand "Dorothy took the aspirins. Her pain went away," one…

This study proposes a structured constructs model (SCM) to examine measurement in the context of a multidimensional learning progression (LP). The LP is assumed to have features that go beyond a typical multidimentional IRT model, in that there are hypothesized to be certain cross-dimensional linkages that correspond to requirements between the…

Humans have a unique ability to generate novel norms. Faced with the knowledge that there are hungry children in Somalia, we easily and naturally infer that we ought to donate to famine relief charities. Although a contentious and lively issue in metaethics, such inference from "is" to "ought" has not been systematically…

The presence of student teamwork is increasing in most university degrees. However, there is still a gap in the literature regarding the connection between teamwork processes and their outcomes. In this paper, the authors analyze these processes and how they relate to teamwork outcomes from the students' perspective. Data was gathered from 129…