Large-scale educational assessments such as the National Assessment of Educational Progress (NAEP) sample examinees to whom an exam will be administered. In most situations the sampling design is not a simple random sample and must be accounted for in the estimating model. After reviewing the current operational estimation procedure for NAEP, this…

In order to determine the effectiveness of multidimensional scaling (MDS) in recovering the dimensionality of a set of dichotomously-scored items, data were simulated in one, two, and three dimensions for a variety of correlations with the underlying latent trait. Similarity matrices were constructed from these data using three margin-sensitive…

The purpose of this study was to compare the results of an analysis of covariance design to a method developed by the authors called within-class regression. Application of this statistical method can be to any quasiexperimental design with a large number of groups. A test of statistical significance to use with the within-class regression…

In an experiment manipulating artificial data in a factorial design, model misspecification and varying levels of error in measurement and in model structure are shown to have significant effects on LISREL parameter estimates in a modified peer influence model. (Author/LMO)

A solution to the problem of specification error due to excluded variables in statistical models of treatment effects in nonrandomized (nonequivalent) control group designs is presented. It involves longitudinal observation with at least two pretests. A maximum likelihood estimation program such as LISREL may provide reasonable estimates of…

This paper comments on the impact of computers on statistical analysis and presents a concise, nontechnical overview of five statistical methods now being applied in educational research. Appropriate uses of these techniques are pointed out, along with dangers concerning misapplications. (PP)

Forming the matching variable for the Mantel-Haenszel differential item functioning (DIF) procedure through use of the total score as the matching variable (thin) and forming the matching variable by pooling total score levels (thick) were compared in a Monte Carlo study. Reasons thick matching is superior are discussed. (SLD)

The Monte Carlo procedure of generating random points that lie within the unit square is used to approximate pi, as the ratio of points within the first quadrant of the unit circle to the total number of randomly generated points. A BASIC computer program for this method is included. (JJK)

Discusses the impact of teaching econometrics, particularly the theoretical aspects, in a computer classroom focusing on the hands-on and discovery learning approaches that computers encourage. Explores the problems that occur when teaching in a computer classroom, such as the increase in course preparation time. Includes reactions by Jeffrey…

This article presents an in-class Monte Carlo demonstration, designed to demonstrate to students the implications of multicollinearity in a multiple regression study. In the demonstration, students already familiar with multiple regression concepts are presented with a scenario in which the "true" relationship between the response and…

In this paper we report on the development of a stochastic modeling course for chemical engineers in the fourth year of the Cambridge Chemical Engineering Syllabus. The general course structure is presented and an interactive Web module, which is used in the course, is presented in more detail. The central aim of the Web module is to enable…

Multidimensional item response theory (IRT) models have been proposed for better understanding the dimensional structure of data or to define diagnostic profiles of student learning. A compensatory multidimensional two-parameter partial credit model (M-2PPC) for constructed-response items is presented that is a generalization of those proposed to…

This Monte Carlo study examined the effect of complex sampling of items on the measurement of differential item functioning (DIF) using the Mantel-Haenszel procedure. Data were generated using a three-parameter logistic item response theory model according to the balanced incomplete block (BIB) design used in the National Assessment of Educational…

An important topic presented in introductory statistics courses is the estimation of population parameters using samples. Students learn that when estimating population variances using sample data, we always get an underestimate of the population variance if we divide by n rather than n-1. One implication of this correction is that the degree of…

This research program was designed to investigate the applications of item response theory and computerized adaptive testing to the unique problems of the measurement of ability and the measurement of achievement. The research utilized a combination of monte carlo simulation studies and live-testing studies. The research approach for adaptive…