Through Monte Carlo simulation, respective normative and intuitive strategies for covariation assessment and Bayesian inference are compared. Results indicate that better performance in both tasks results from considering alternative hypotheses, although not necessarily using a normative strategy. Conditions under which intuitive strategies may be…

A modification of a test of the equality of nonindependent alpha reliability coefficients is proposed. It avoids the limitation that the product of the number of test parts times the number of subjects be quite large. Monte Carlo studies indicate that this test can be used in comparing interrater reliabilities. (SLD)

Compared reality therapy and person-centered therapy practiced by an African American counselor and a European American counselor. Results from African American Job Corps participants who viewed videotapes depicting simulated counseling sessions show a statistically significant difference between the therapies and between the counselors. Higher…

Two groups of three students with moderate mental retardation were instructed using group procedures to compare static picture and video prompting simulation strategies. An alternating treatments design was used to compare individual student task acquisition and maintenance performances of purchasing and banking skills. The results indicated that…

Structural equation models are widely appreciated in social-psychological research and other behavioral research to model relations between latent constructs and manifest variables and to control for measurement error. Most applications of SEMs are based on fully observed continuous normal data and models with a linear structural equation.…

This paper compares two protocols for web-based instruction using simulations in an introductory physics class. The Inquiry protocol allowed students to control input parameters while the Worked Example protocol did not. Students in the Worked Example group performed significantly higher on a common assessment. The ramifications of this study are…

The performance of methods for detecting publication bias in meta-analysis was evaluated using Monte Carlo methods. Four methods of bias detection were investigated: Begg's rank correlation, Egger's regression, funnel plot regression, and trim and fill. Five factors were included in the simulation design: number of primary studies in each…

The authors compare the operating characteristics of the bootstrap-F approach, a direct extension of the work of Berkovits, Hancock, and Nevitt, with Huynh's improved general approximation (IGA) and the Brown-Forsythe (BF) multivariate approach in a mixed repeated measures design when normality and multisample sphericity assumptions do not hold.…

This study examined the impact of NISL's [National Institute for School Leadership's] Executive Development Program for principals on student achievement in Pennsylvania schools between 2006-2009. Roughly half of the NISL-trained principals started the program during the 2007 school year and completed it in the 2008 school year, whereas the other…

The interest in the application of large-scale computerized adaptive testing has served to focus attention on issues that arise when theoretical advances are made operational. Some of these issues stem less from changes in testing conditions and more from changes in testing paradigms. One such issue is that of the order in which questions are…

Two-stage and multistage test designs provide a way of roughly adapting item difficulty to test-taker ability. All test takers take a parallel stage-one test, and, based on their scores, they are routed to tests of different difficulty levels in subsequent stages. These designs provide some of the benefits of standard computerized adaptive testing…

Studies of differential item functioning (DIF) under item response theory require that item parameter estimates be placed on the same metric before comparisons can be made. Evidence that methods for linking metrics may be influenced by the presence of differentially functioning items has been inconsistent. The effects of three methods for linking…

The Random Normal Scores Test (RNST) has been suggested as a powerful alternative to the use of the parametric analysis of variance (ANOVA) test when the underlying population is non-normally distributed. The major support for this suggestion rests on asymptotic theory. An empirical analysis of the RNST performed under the F and Chi-square…

Computerized adaptive testing procedures (CATPs) based on the graded response method (GRM) of F. Samejima (1969) and the partial credit model (PCM) of G. Masters (1982) were developed and compared. Both programs used maximum likelihood estimation of ability, and item selection was conducted on the basis of information. Two simulated data sets, one…

The purpose of this study was to develop and evaluate a series of simulation dialogs utilizing certain computer capabilities. The series of simulations produced in the study parallel the fundamental, inductive experiments developed by the Physical Science Study Committee (PSSC) through which students generalize Newton's Second Law. Students…