This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

The philosophy and assumptions of the Multi-Attribute Utility-Bayesian Decision Theoretic model (MAUT-Bayesian model) are presented. The evaluator uses the MAUT-Bayesian model along with the knowledge of the decision-maker's, and perhaps the evaluator's own values to decide what data should be collected. Appropriate data are presented to the…

Evaluation is increasingly taken as a public good, as an activity aimed at development and betterment. At the same time, evaluation is increasingly integrated in accountability movements and in institutionalized systems for governance. It is also embedded in a consumer-oriented New Public Management ideology. Against this background, it is high…

In this paper four classes of procedures for measuring the instructional sensitivity of reading comprehension test items are reviewed. True experimental designs are not recommended because some of the most important reading comprehension variables do not lend themselves to experimental manipulation. "Ex post facto" factorial designs are…

Presents two statistical topics and examples of their use in natural resource monitoring. The first topic deals with use of correlated observations in calculations of variance estimates for a regional mean, required sample size determination, and confidence intervals. The second topic concerns the use of Bayesian techniques in hypothesis testing.…

The Multi-Attribute Utilities Theory (MAUT), a model for the evaluation of public postsecondary programs, is presented and is applied to a study of WINNERS (Women's Inner-City Educational Resources Service) with an analysis of the effects of the model on the program. The first chapter provides an overview of the MAUT approach, outlining 16 steps…

In this article, a new method is presented and implemented for deriving a scale of socioeconomic status (SES) from international survey data using a multilevel Bayesian item response theory (IRT) model. The proposed model incorporates both international anchor items and nation-specific items and is able to (a) produce student family SES scores…

In this article, we formulate a nonlinear structural equation model (SEM) that can accommodate covariates in the measurement equation and nonlinear terms of covariates and exogenous latent variables in the structural equation. The covariates can come from continuous or discrete distributions. A Bayesian approach is developed to analyze the…

Methods for predicting specific college course grades, based on small numbers of observations, were investigated. These methods use collateral information across potentially diverse institutions to obtain refined within-group parameter estimates. One method, referred to as pooled least squares with adjusted intercepts, assumes that slopes and…

In this lead article three emergent problems in the analysis of cross-national survey data are raised in a context of 40 years of research and development in a field where persistent problems have arisen and where scholars across the world have sought solutions. Anomalous results have been found from secondary data analyses that would appear to…

This study used the Bayesian Theorem and cost/effectiveness analysis to measure the short and long range effectiveness and minimum costs of individualized instructional units constructed by educational development officers for use with low-income students at four North Carolina technical institutes designated as developing institutions. Students…

Bayesian networks are frequently used in educational assessments primarily for learning about students' knowledge and skills. There is a lack of works on assessing fit of Bayesian networks. This article employs the posterior predictive model checking method, a popular Bayesian model checking tool, to assess fit of simple Bayesian networks. A…

Two methods of using collateral information from similar institutions to predict college freshman grade average were investigated. One central prediction model, referred to as pooled least squares with adjusted intercepts, assumes that slopes and residual variances are homogeneous across selected colleges. The second model, referred to as Bayesian…

The validity of American College Testing Program (ACT) test scores and self-reported high school grades for predicting grades in specific college freshman courses was studied. Specific course grades are typically used to place students in remedial, standard, or advanced classes. These placement decisions, in turn, have immediate implications for…