This paper discusses the application of Hierarchical Linear Modeling (HLM) to the evaluation of the effectiveness of Basic Skills programs in the Newark (New Jersey) school district. Whether HLM is able to handle regression effects in Basic Skills examination data is studied. The analysis uses data from the Stanford Achievement Tests for…

In this paper, academic efficiency is operationally defined and a methodology for measuring it at the school level is described. Academic efficiency is defined as the extent to which a school utilizes its time for the academic development of all its students. The measure of academic efficiency must include three elements: time, students, and…

Complex decision-making environments often demand that a range of alternative strategies be identified and compared for their shared value in achieving desired ends. Simple parametric statistical procedures such as analysis of variance and discriminant function analysis can be used in such situations to compare (using selected criteria) the value…

Historical regression uses the assumption that without intervention, growth at post-test will proceed at the same rate as at pre-test. Several methods of historical regression are compared with an illustrative example. (JKS)

A method for detecting instructional sensitivity (item bias) in test items is proposed. This method extends item response theory by allowing for item-specific variation in measurement relations across students' varying instructional backgrounds. Item bias detection is a by-product. Traditional and new methods are compared. (SLD)

The development of new statistical methods of log-linear models by Leo Goodman has led to major advances in the statistical analysis of categorical data. Goodman's logit analysis, (the simplest form of log-linear models) can be applied in evaluation studies to estimate the "main effects" and "interaction effects" of categorical…

The effects of certain characteristics (e.g., sample design) of National Assessment of Educational Progress (NAEP) data on statistical analysis techniques are considered. Ignoring special features of NAEP data and proceeding with a standard analysis can produce inferences that underestimate the true variability and overestimate the true degrees of…

A general longitudinal model is presented for estimating school effects and their stability. The model, capable of separating true changes from sampling and measurement error, controls statistically for effects of factors exogenous to the school system. The model is illustrated with data from large cohorts of students in Scotland. (SLD)

This study introduced a probabilistic model utilizing item response theory (IRT) for dealing with a variety of misconceptions. The model can be used for evaluating the transition behavior of error types, advancement of learning stages, or the stability and persistence of particular misconceptions. Moreover, it apparently can be used for relating…

This volume is an exposition of a mathematical modeling technique for use in the evaluation and solution of complex educational problems at all levels. It explores in detail the application of simple algebraic techniques to such issues as program reduction, fiscal rollbacks, and computer curriculum planning. Part I ("Introduction to the…

In the Spring, 1996, issue of "CRESST Line," E. Baker and R. Linn commented that, in efforts to measure the progress of schools, "the fluctuations due to differences in the students themselves could conceal differences in instructional effects." This is particularly true in the context of the evaluation of adequate yearly…

Pennsylvania's mathematical modeling technique to evaluate tax reform proposals requires the following data: personal income at the local level and measures of the breakdown of property tax payment by land use classification. The simulation technique could be readily adapted in reorganizing educational finance systems. (MLF)

Regression-based adjustment of student outcomes for the assessment of the merit of schools is considered. First, the basics of causal modeling and multiple regression are briefly reviewed. Then, two common regression-based adjustment procedures are described, pointing out that the validity of the final assessments depends on: (1) the degree to…

Empirical findings lend credence to the postulation that differences among teachers regarding content knowledge ( being more pronounced in the upper grades regarding cognitive attainment of course specific content), instructional skills, and teaching experience do result in cognitive attainment differences among classes of learners. (Author/RL)

Procedures for obtaining student samples for the National Assessment of Educational Progress (NAEP) and deriving survey weights for analysis of survey data are described. Sample designs are economically and operationally feasible, and weighting procedures result in increased precision of estimates as they account for the probabilities of student…