Using reasonable values for the parameters in both null and alternative hypotheses about covariance matrices, an optimal and feasible combination of number of subjects, significance level, and power of the test were determined for an empirical study of the measurement of musical ability. (Author/BW)

Reviews case against using traditional statistical methods in educational research. Examines "fantasies" entertained by researchers about the meaning of statistical significance. Recommends abandoning statistical significance testing and suggests other ways of evaluating research results. Advocates a return to the scientific method of examining…

Proposes modifications to the recent suggestions by B. Thompson (1996) for an American Educational Research Association editorial policy on statistical significance testing. Points out that, although it is useful to include effect sizes, they can be misinterpreted, and argues, as does Thompson, for greater attention to replication in educational…

The properties of Tucker's congruence coefficient--an index used to help determine the equality of latent structures for different subgroups on a common set of test items--are explored. An example using data from 1,370 subjects in the National Assessment of Educational Progress 1976 mathematics assessment illustrates the index's use. (SLD)

A method of item factor analysis is described, which is based on Thurstone's multiple-factor model and implemented by marginal maximum likelihood estimation and the EM algorithm. Also assessed are the statistical significance of successive factors added to the model, provisions for guessing and omitted items, and Bayes constraints. (TJH)

Strategies are presented for analyzing longitudinal research designs with many waves of data using hierarchical linear modeling. The approach defines well-focused parameters that yield meaningful effect size estimates and significance tests. It is illustrated with data from the Boys Town Follow-Up Study. (SLD)

Formulae for estimating individual rater reliabilities from analysis of treatment effects are presented and evaluated. Monte Carlo methods illustrate the formulae. Results indicate that large sample sizes, large true treatment effects, and large differences in the actual reliabilities of raters are required for the approach to be useful. (SLD)

The following models which provide an estimate of the reliability of a rating scale are described: (1) disattenuation; (2) common factor; (3) external criterion; (4) treatment effects; and (5) regression. Such models are especially useful in selecting, evaluating, and training participants in clinical research. (SLD)

A method is proposed for calculating the sample size needed to achieve acceptable statistical power with a given test. The minimally important difference significant (MIDS) criterion for sample size is explained and supported with recommendations for determining sample size. The MIDS criterion is computationally simple and easy to explain. (SLD)

Presents an opinion on the appropriate use of significance tests, especially in the context of regression analysis, the most commonly encountered statistical technique in education and related disciplines. Briefly discusses the appropriate use of power analysis. Contains 47 references. (Author/SV)

Describes how to incorporate the concept of significant figures into science activities to promote understanding. Provides helpful classroom examples using measurements of volume and length. (SAH)

Research indicates that both home literacy activities and direct instruction of reading skills promote reading development. The current study investigates how parent-led direct teaching activities impact emergent literacy. Preschool children (n = 47) were administered subtests from the Test of Early Reading Ability-3 and the Kaufman Survey of…

The present essay outlines how mixed methods research can be used to enhance the interpretation of significant findings. First, we define what we mean by significance in educational evaluation research. With regard to quantitative-based research, we define the four types of significance: statistical significance, practical significance, clinical…

Objective: The establishment of the Family Violence Option (FVO) in 1997 was met with some controversy, as critics believed waivers from time limit and work requirements would hinder women's ability to leave welfare and find employment. Method: Using administrative and interview data from Maryland, multivariate equations analyze if domestic…

The relationship between the philosophical orientation of a high school citizenship education program and the kinds of competencies that students exhibit on a nationally administered civics knowledge assessment was investigated. The researcher imposed a philosophical paradigm of political perfectionism on the citizenship education curriculum in…