This article proposes an item response theory (IRT) approach to constructing and scoring multidimensional pairwise preference items. Individual statements are administered and calibrated using a unidimensional single-stimulus model. Tests are created by combining multidimensional items with a small number of unidimensional pairings needed to…

This study extended client-focused research by using the nearest neighbor (NN) approach, a client-specific sampling and prediction strategy derived from research on alpine avalanches. Psychotherapy clients (N = 203) seen in routine practice settings in the United Kingdom completed a battery of intake measures and then completed symptom intensity…

Whereas some research on immediate recall of verbal lists has suggested that it is limited by the number of chunks that can be recalled (e.g., N. Cowan, Z. Chen, & J. N. Rouder, 2004; E. Tulving & J. E. Patkau, 1962), other research has suggested that it is limited by the length of the material to be recalled (e.g., A. D. Baddeley, N. Thomson, &…

One conceptualization of meta-analysis is that studies within the meta-analysis are sampled from populations with mean effect sizes that vary (random-effects models). The consequences of not applying such models and the comparison of different methods have been hotly debated. A Monte Carlo study compared the efficacy of Hedges and Vevea's…

This study compares the classification accuracy of linear discriminant analysis (LDA), quadratic discriminant analysis (QDA), logistic regression (LR), and classification and regression trees (CART) under a variety of data conditions. Past research has generally found comparable performance of LDA and LR, with relatively less research on QDA and…

Seance-room and other large-scale psychokinetic phenomena have fascinated humankind for decades. Experimental research has reduced these phenomena to attempts to influence (a) the fall of dice and, later, (b) the output of random number generators (RNGs). The meta-analysis combined 380 studies that assessed whether RNG output correlated with human…

Generative response modeling is an approach to test development and response modeling that calls for the creation of items in such a way that the parameters of the items on some response model can be anticipated through knowledge of the psychological processes and knowledge required to respond to the item. That is, the computer would not merely…

By employing a concomitant variable, researchers can reduce the error, increase the precision, and maximize the power of an experimental design. Blocking and analysis of covariance (ANCOVA) are most often used to harness the power of a concomitant variable. Whether to block or covary and how many blocks to be used if a block design is chosen…

This Monte Carlo study examined strategies for forming the matching variable for the Mantel-Haenszel (MH) differential item functioning (DIF) procedure. Data were generated using a three-parameter logistic item response theory model, with common guessing parameters. The number of subjects and test length were manipulated, as were the difficulty,…

The Bootstrap method, a computer-intensive statistical method of estimation, is illustrated using a simple and efficient Statistical Analysis System (SAS) routine. The utility of the method for generating unknown parameters, including standard errors for simple statistics, regression coefficients, discriminant function coefficients, and factor…

Concern over the validity of statistical tests performed on data that may not satisfy underlying assumptions has prompted methodological researchers to perform Monte Carlo studies for frequently used tests. Unfortunately, these studies appear to have had little impact on methodological practice. One reason is the lack of an overarching framework…

The purpose of this study was to develop a single procedure for comparing population variances which could be used for distribution forms. Bootstrap methodology was used to estimate the variability of the sample variance statistic when the population distribution was normal, platykurtic and leptokurtic. The data for the study were generated and…

The Random Normal Scores Test (RNST) has been suggested as a powerful alternative to the use of the parametric analysis of variance (ANOVA) test when the underlying population is non-normally distributed. The major support for this suggestion rests on asymptotic theory. An empirical analysis of the RNST performed under the F and Chi-square…

Factors affecting a lower-bound estimate of internal consistency reliability, Cronbach's coefficient alpha, are explored. Theoretically, coefficient alpha is an estimate of the correlation between two tests drawn at random from a pool of items like the items in the test under consideration. As a practical matter, coefficient alpha can be an index…

J. A. Emrick's (1971) model is a latent class model of mastery testing that can be used to estimate the proportion of masters in a given population. A. Hamerle (1980), in a recent paper on this model, has proposed an estimator for the proportion of masters that is claimed to constitute a maximum likelihood approach. It is indicated that Hamerle is…