This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

This paper deals with the problems that arise in performance assessment from the granularity that results from having a small number of tasks or prompts and raters of responses to these tasks or prompts. Two problems are discussed in detail: (1) achieving a satisfactory degree of reliability; and (2) equating or adjusting for differences of…

In recent assessments, the National Center for Education Statistics (NCES) has permitted schools to exclude some students with disabilities or limited English proficiency because it believed that its assessments would not accurately measure the ability and achievement levels of these students. The exclusion of a portion of students from…

This sourcebook in the 7th year of its annual publication is the second in a series of statistical sourcebooks covering significant topics in American life. It addresses the need for a single volume statistical reference through a collection of tables that display information on a wide variety of topics. With a few exceptions, each table presents…

This paper analyzes trends in education expenditures in elementary and secondary schools, especially the extent to which special education costs are responsible for the overall upward expenditure trends. It reports on the limited national data available and on a longitudinal analysis of special education costs in Milwaukee, Wisconsin, from 1982-83…

The purpose of this study was to explore how adult users interact and learn during a computer-based simulation given visual and verbal forms of feedback coupled with embedded elaborations of the content. A total of 52 college students interacted with a computer-based simulation of Newton's laws of motion in which they had control over the motion…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics and logical deduction. Questions should ask more than mere knowledge of facts and should not contain superfluous information as an introduction to the question. Each question should focus on some specific aspect of the course, and the item…

It is only a slight exaggeration to describe the test theory that dominates educational measurement today as the application of twentieth-century statistics to nineteenth-century psychology. Sophisticated estimation procedures, new techniques for missing-data problems, and theoretical advances into latent-variable modeling have appeared--all…

Data assembled from the sequence of Current Population Survey (CPS) tenure supplements for 1973, 1978, 1981, 1983, 1987, and 1991 were analyzed along with demographic characteristics and other variables available from the general CPS to identify changes in job retention rates in the United States throughout the 1980s. The analysis was based on…

Proper placement of students into either remedial writing or Composition I can be crucial to their success in higher education. Using a database of nearly 6,000 students who entered an open admissions community college in Texas, the researchers attempted to discover the best predictor of student success in Composition I. For students who took a…

Many students view statistics as their worst college course. Four heuristics that can improve students' proficiency in statistics and in interpreting reports of research are presented in this paper. The heuristics guide students' judgments about significance, generalizability, cause-and-effect, and strength of independent-dependent variable…

This paper describes the methodology used by The College of St. Rose (New York) to identify peer institutions (similar small private liberal arts colleges) as part of a comparative compensation survey. To identify peer institutions, researchers used a hybrid approach involving both objective identification of institutions and administrator…

Data Envelopment Analysis (DEA) is an objective statistical technique for discovering the comparative ranking of organizations with respect to their efficiency. The technique, which assesses the relationship between resources (inputs) and outcomes (outputs) may also be used to discover what variables make organizations effective and efficient in…

The impact that high school and college experiences and activities have on students' musical independence (MI) was investigated. MI is related to the actual production and performance of music, as opposed to musical achievement or the mastery of any academic skill related to music. Colwell's Musical Achievement Test 3, Musical Achievement Test 4,…

Spoken narratives as a genre usually show literary stylistic features. Written/literary registers are characterized by lexical density whereas spoken/colloquial genres are characterized by the complex combination of simple clauses into clause complexes. It has been observed that when aiming at informationally dense speech, people often hesitate…