Developed an extension of the Rasch model from a Bayesian point of view and used the model to study whether learning occurred throughout a computer-administered intelligence test. Results from 137 college students indicate that learning did occur and that there might be individual differences in learning rate. (SLD)

The challenges of modeling students' performance in computer-based interactive assessments include accounting for multiple aspects of knowledge and skill that arise in different situations and the conditional dependencies among multiple aspects of performance. This article describes a Bayesian approach to modeling and estimating cognitive models…

The Individuals With Disabilities Education Act (IDEA) Amendments of 1997 mandate the use of functional behavioral assessment (FBA) and positive behavioral supports and interventions for students with disabilities. Although much progress has been made in our understanding of functional analysis over the past 15 years, the extent to which these…

Two psychometric models are presented for evaluating the difficulty of the distractors in multiple-choice items. They are based on the criterion of rising distractor selection ratios, which facilitates interpretation of the subject and item parameters. Statistical inferential tools are developed in a Bayesian framework: modal a posteriori…

Multi-indicator growth models were formulated as special three-level hierarchical generalized linear models to analyze growth of a trait latent variable measured by ordinal items. Items are nested within a time-point, and time-points are nested within subject. These models are special because they include factor analytic structure. This model can…

In November of 2007, Alberta Advanced Education and Technology contracted Insightrix Research, Inc. to conduct a survey of individuals who graduated from post-secondary institutions in Alberta in the fall of 2005 or the spring of 2006 (excluding apprenticeship graduates, who are surveyed through a separate initiative). The purpose of the survey is…

In this article, a new method is presented and implemented for deriving a scale of socioeconomic status (SES) from international survey data using a multilevel Bayesian item response theory (IRT) model. The proposed model incorporates both international anchor items and nation-specific items and is able to (a) produce student family SES scores…

In this article, we formulate a nonlinear structural equation model (SEM) that can accommodate covariates in the measurement equation and nonlinear terms of covariates and exogenous latent variables in the structural equation. The covariates can come from continuous or discrete distributions. A Bayesian approach is developed to analyze the…

Disclosing information, thoughts, and feelings about personal and meaningful topics (experimental disclosure) is purported to have various health and psychological consequences (e.g., J.W. Pennebaker, 1993). Although the results of 2 small meta-analyses (P. G. Frisina, J. C. Borod, & S. J. Lepore, 2004; J. M. Smyth, 1998) suggest that experimental…

What people mean by randomness should be taken into account when teaching statistical inference. This experiment explored subjective beliefs about randomness and probability through two successive tasks. Subjects were asked to categorize 16 familiar items: 8 real items from everyday life experiences, and 8 stochastic items involving a repeatable…

Sophisticated software such as Virtual Learning Environments (VLEs) are rapidly being deployed by universities. Despite widespread use of such systems, experience shows that there is frequently poor pedagogic development, leading primarily to use of VLEs as electronic document repositories rather than as online learning systems in which the…

This paper describes a study, now in progress, of new methods for representing the sampling variability of Mantel-Haenszel differential item functioning (DIF) results, based on the system for categorizing the severity of DIF that is now in place at the Educational Testing Service. The methods, which involve a Bayesian elaboration of procedures…

The question of how to analyze unbalanced hierarchical data generated from structural equation models has been a common problem for researchers and analysts. Among difficulties plaguing statistical modeling are estimation bias due to measurement error and the estimation of the effects of the individual's hierarchical social milieu. This paper…

Operational procedures for the Graduate Record Examinations Validity Study Service are reviewed, with emphasis on the problem of frequent occurrence of negative coefficients in the fitted within-department regressions obtained by the empirical Bayes method of H. I. Braun and D. Jones (1985). Several alterations of the operational procedures are…

Because public schools do not randomly assign students and teachers across schools (a methodological utopia), multilevel evaluation methods which account for student and school contextual and practice variables in their natural settings provide the most rigorous means for showing empirically what is actually happening in school classrooms.…