This case study illustrates the application of Mega--adding measurable value for all stakeholders including society--as the central and ultimate focus for needs assessment. In this case, two needs assessment studies were conducted within a five-year period (1999-2003) with the State of Ohio's Workforce Development (WD) program. An initial needs…

This article presents the results of an 11-year longitudinal study of the impact of America's Choice comprehensive school reform (CSR) design on student learning gains in Rochester, New York. A quasi-experimental interrupted time-series approach using Bayesian hierarchical growth curve analysis with crossed random effects is used to compare the…

Bayesian networks are frequently used in educational assessments primarily for learning about students' knowledge and skills. There is a lack of works on assessing fit of Bayesian networks. This article employs the posterior predictive model checking method, a popular Bayesian model checking tool, to assess fit of simple Bayesian networks. A…

The three-year Early Childhood Emergent Literacy Technology Curriculum (ELiTeC) study (E2) was designed to replicate, on a broad scale, the results of earlier research in which a curriculum model was developed, implemented, and studied in preschool classrooms for children with disabilities or those at risk. ELiTeC was based on the assumptions that…

By means of more than a dozen user friendly packages, structural equation models (SEMs) are widely used in behavioral, education, social, and psychological research. As the underlying theory and methods in these packages are vulnerable to outliers and distributions with longer-than-normal tails, a fundamental problem in the field is the…

Analyses for results of a series of studies examining intercorrelations among a set of as many as p+1 variables are presented. Several estimators of a pooled or average correlation vector and its variances are derived for cases in which some studies do not report complete correlation matrices. A test of the homogeneity (consistency) of the…

The issue of test-item selection in support of decision making in adaptive testing is considered. The number of items needed to make a decision is compared for two approaches: selecting items from an item pool that are most informative at the decision point or selecting items that are most informative at the examinee's ability level. The first…

Researchers have been limited in their ability to examine multiple constructs simultaneously due to the constraints imposed by traditional statistical methods. The most notable limitations include the need for a relatively large sample size while restricting the variables to a relatively small number. The application of a newly discovered…

The rule space model permits measurement of cognitive skill acquisition, diagnosis of cognitive errors, and detection of the strengths and weaknesses of knowledge possessed by individuals. Two ways to classify an individual into his or her most plausible latent state of knowledge include: (1) hypothesis testing--Bayes' decision rules for minimum…

The problems associated with misclassifying students when pass-fail decisions are based on test scores are discussed. One protection against misclassification is to set a confidence interval around the cutting score. Those whose scores fall above the interval are passed; those whose scores fall below the interval are failed; and those whose scores…

Bayesian estimation procedures are summarized and numerically illustrated by means of simulation methods. Procedures of data generation for simulation purposes are also delineated and computationally demonstrated. The logistic model basic to the Bayesian estimation procedures is shown to be explicit with respect to the probability distribution…

This paper seeks to extend the application of Markov chain Monte Carlo (MCMC) methods in item response theory (IRT) to include the estimation of equating relationships along with the estimation of test item parameters. A method is proposed that incorporates estimation of the equating relationship in the item calibration phase. Item parameters from…

Implications of case specificity in two computer-based clinical-simulation examination cases were examined by a classical measurement approach and by a Bayesian analysis of test characteristics. Results from 163 medical students indicate that such examinations cannot be used in high-stakes situations without additional research. (SLD)

A validity study with 5,219 students examined the degree to which Graduate Management Admission Test (GMAT) scores and undergraduate grade point average (GPA) could predict first-year average and final GPA in doctoral programs in business. The usefulness of the predictions derived from the empirical Bayes regression models is discussed. (SLD)

This study addressed concerns about the potential for differential gains in reading during the first 2 years of formal schooling (K-1) versus the next 2 years of schooling (1st-3rd grade). A multilevel piecewise regression with a node at spring 1st grade was used in order to define separate regressions for the two time periods. Empirical Bayes…