Publication Date
| In 2026 | 0 |
| Since 2025 | 0 |
| Since 2022 (last 5 years) | 0 |
| Since 2017 (last 10 years) | 0 |
| Since 2007 (last 20 years) | 7 |
Descriptor
| Bayesian Statistics | 9 |
| Evaluation Problems | 9 |
| Evaluation Methods | 7 |
| Research Methodology | 7 |
| Experiments | 5 |
| Hypothesis Testing | 5 |
| Measurement Techniques | 5 |
| Misconceptions | 5 |
| Probability | 5 |
| Replication (Evaluation) | 5 |
| Statistical Inference | 5 |
| More ▼ | |
Source
| Psychological Methods | 5 |
| American Journal of Evaluation | 1 |
| Educational and Psychological… | 1 |
| Evaluation Review | 1 |
| International Education… | 1 |
Author
Publication Type
| Journal Articles | 9 |
| Reports - Research | 3 |
| Opinion Papers | 2 |
| Reports - Descriptive | 2 |
| Reports - Evaluative | 2 |
Education Level
| Adult Education | 1 |
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Park, Jungkyu; Yu, Hsiu-Ting – Educational and Psychological Measurement, 2016
The multilevel latent class model (MLCM) is a multilevel extension of a latent class model (LCM) that is used to analyze nested structure data structure. The nonparametric version of an MLCM assumes a discrete latent variable at a higher-level nesting structure to account for the dependency among observations nested within a higher-level unit. In…
Descriptors: Hierarchical Linear Modeling, Nonparametric Statistics, Data Analysis, Simulation
Maraun, Michael; Gabriel, Stephanie – Psychological Methods, 2010
In his article, "An Alternative to Null-Hypothesis Significance Tests," Killeen (2005) urged the discipline to abandon the practice of "p[subscript obs]"-based null hypothesis testing and to quantify the signal-to-noise characteristics of experimental outcomes with replication probabilities. He described the coefficient that he…
Descriptors: Hypothesis Testing, Statistical Inference, Probability, Statistical Significance
Killeen, Peter R. – Psychological Methods, 2010
Lecoutre, Lecoutre, and Poitevineau (2010) have provided sophisticated grounding for "p[subscript rep]." Computing it precisely appears, fortunately, no more difficult than doing so approximately. Their analysis will help move predictive inference into the mainstream. Iverson, Wagenmakers, and Lee (2010) have also validated…
Descriptors: Replication (Evaluation), Measurement Techniques, Research Design, Research Methodology
Lecoutre, Bruno; Lecoutre, Marie-Paule; Poitevineau, Jacques – Psychological Methods, 2010
P. R. Killeen's (2005a) probability of replication ("p[subscript rep]") of an experimental result is the fiducial Bayesian predictive probability of finding a same-sign effect in a replication of an experiment. "p[subscript rep]" is now routinely reported in "Psychological Science" and has also begun to appear in…
Descriptors: Research Methodology, Guidelines, Probability, Computation
Iverson, Geoffrey J.; Wagenmakers, Eric-Jan; Lee, Michael D. – Psychological Methods, 2010
The purpose of the recently proposed "p[subscript rep]" statistic is to estimate the probability of concurrence, that is, the probability that a replicate experiment yields an effect of the same sign (Killeen, 2005a). The influential journal "Psychological Science" endorses "p[subscript rep]" and recommends its use…
Descriptors: Effect Size, Evaluation Methods, Probability, Experiments
Cumming, Geoff – Psychological Methods, 2010
This comment offers three descriptions of "p[subscript rep]" that start with a frequentist account of confidence intervals, draw on R. A. Fisher's fiducial argument, and do not make Bayesian assumptions. Links are described among "p[subscript rep]," "p" values, and the probability a confidence interval will capture…
Descriptors: Replication (Evaluation), Measurement Techniques, Research Methodology, Validity
Hardin, J. Michael; Anderson, Billie S.; Woodby, Lesa L.; Crawford, Myra A.; Russell, Toya V. – Evaluation Review, 2008
This article explores the statistical methodologies used in demonstration and effectiveness studies when the treatments are applied across multiple settings. The importance of evaluating and how to evaluate these types of studies are discussed. As an alternative to standard methodology, the authors of this article offer an empirical binomial…
Descriptors: Bayesian Statistics, Alternative Assessment, Data Analysis, Statistical Studies
Segerholm, Christina – American Journal of Evaluation, 2003
Evaluation is increasingly taken as a public good, as an activity aimed at development and betterment. At the same time, evaluation is increasingly integrated in accountability movements and in institutionalized systems for governance. It is also embedded in a consumer-oriented New Public Management ideology. Against this background, it is high…
Descriptors: State Surveys, National Surveys, Evaluation Methods, Evaluation Research
Keeves, John P.; Lietz, Petra; Gregory, Kelvin; Darmawan, I Gusti Ngurah – International Education Journal, 2006
In this lead article three emergent problems in the analysis of cross-national survey data are raised in a context of 40 years of research and development in a field where persistent problems have arisen and where scholars across the world have sought solutions. Anomalous results have been found from secondary data analyses that would appear to…
Descriptors: Research and Development, Academic Achievement, Computation, National Surveys

Peer reviewed
Direct link
