There exists a variety of interval estimators for the overall treatment effect in a random-effects meta-analysis. A recent literature review summarizing existing methods suggested that in most situations, the Hartung-Knapp/Sidik-Jonkman (HKSJ) method was preferable. However, a quantitative comparison of those methods in a common simulation study…

Conventional estimators for indirect effects using a difference in coefficients and product of coefficients produce the same results for continuous outcomes. However, for binary outcomes, the difference in coefficient estimator systematically underestimates the indirect effects because of a scaling problem. One solution is to standardize…

Growth mixture modeling is generally used for two purposes: (1) to identify mixtures of normal subgroups and (2) to approximate oddly shaped distributions by a mixture of normal components. Often in applied research this methodology is applied to both of these situations indistinctly: using the same fit statistics and likelihood ratio tests. This…

This article presents findings on the consequences of matrix sampling of context questionnaires for the generation of plausible values in large-scale assessments. Three studies are conducted. Study 1 uses data from PISA 2012 to examine several different forms of missing data imputation within the chained equations framework: predictive mean…

Given the necessity to bridge the gap between what happened and what is likely to happen, this paper aims to explore how to apply Bayesian inference to cost-effectiveness analysis so as to capture the uncertainty of a ratio-type efficiency measure. The first part of the paper summarizes the characteristics of the evaluation data that are commonly…

In education research, small samples are common because of financial limitations, logistical challenges, or exploratory studies. With small samples, statistical principles on which researchers rely do not hold, leading to trust issues with model estimates and possible replication issues when scaling up. Researchers are generally aware of such…

Researchers in the single-case design tradition have debated the size and importance of the observed autocorrelations in those designs. All of the past estimates of the autocorrelation in that literature have taken the observed autocorrelation estimates as the data to be used in the debate. However, estimates of the autocorrelation are subject to…

Relatively little research has been conducted with the noncompensatory class of multidimensional item response theory (MIRT) models. A Monte Carlo simulation study was conducted exploring the estimation of a two-parameter noncompensatory item response theory (IRT) model. The estimation method used was a Metropolis-Hastings within Gibbs algorithm…

One of six summaries of workshop sessions (See TM 000 130), designed to strengthen the evaluation of costly programs and their effects, this handbook presents an analysis of both random and nonrandom sampling errors by application of the Bayesian model. This model attempts to formalize the process and procedures of inference from data through…

An experimental study of the efficiency of human information processing is based on the Bayesian model for simple hypothesis testing with fixed binomial sampling. Each of 60 subjects is analyzed with separate ANOVAs focusing on two efficiency variables. Sample size and critical value are also analyzed. Subjects show very different utilization of…

This paper develops theory and methods for the application of the Bayesian Model II method to the estimation of binomial proportions and demonstrates its application to educational data. (Author/RK)

A linear classification rule (used with equal covariance matrices) was contrasted with a quadratic rule (used with unequal covariance matrices) for accuracy of internal and external classification. The comparisons were made for seven situations which resulted from combining three data conditions (equal and unequal covariance matrices, minimal and…

The feasibility and effectiveness of a Bayesian method for estimating regressions in m groups is studied by application of the method to data from the Basic Research Service of The American College Testing Program. Evidence supports the belief that in many testing applications the collateral information obtained from each subset of m-1 colleges…

Unlike the past models guiding cross-cultural psychological research, a new paradigm facilitates multiple level investigations by incorporating both culture-specific (nested) and culture-general (crossed) independent variables within its partially-hierarchical framework. Based upon the generalizability analysis, this model generates sequential…