Including all children in large-scale educational studies is a pressing concern. Omitting certain types of children from studies can lead to skewed findings that promote inaccuracies about learning levels or educational quality. Increasingly, assessments are a method for investigating the quality of education systems, but national assessments are…

For more than four decades the National Assessment of Educational Progress (NAEP) has tracked the achievement of U.S. students in major academic subjects. This national resource is the only assessment that states and now many urban districts can look to as an objective yardstick of their performance over time, relative to national benchmarks, and…

The use of fieldwork in evaluation presents the fieldworker and agencies connected with educational evaluation with a number of critical problems. Four of these problems are identified and discussed: 1) definition of the "problem"; 2) multiplicity of signals, expectations, and responses; 3) dispensation of fieldwork data; and 4) collection of data…

The following organizations and agencies sent their suggestions and comments on the National Center for Education Statistics (NCES) Elementary/Secondary Education Data Redesign Project: American Association for Counseling and Development, American Association of Colleges for Teacher Education, American Library Association, Indiana University,…

In large-scale assessments, some amount of background material is generally collected. Background questionnaires in the National Assessment of Educational Progress are the subject of this report. Most of the questions in NAEP background questionnaires have asked about course taking patterns and course content, but it is argued that the material…

The serious problems faced in the ESAA (Emergency School Aid Act) data collection effort (magnitude of the data to be collected, many kinds of respondents, and sensitivity of much of the data) are discussed. Procedures for overcoming obstacles are described. These include limiting collection to essential data, tailoring instruments to respondents,…

Global economic transformations have never been as dramatic as in the twentieth century. Most countries have experienced radical changes in the standards of income per capita, technology, fertility, mortality, income inequality and the extent of democracy in the course of the past century. It is the goal of many disciplines--economics, history,…

This report discusses the findings of a study that attempted to investigate the participation rates of students with disabilities in the Oregon statewide testing program. The study joined individual student data from the Oregon Statewide Assessment Program and the Oregon Special Education Child Count to examine participation rates. The report…

This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

At the request of the Office of the Assistant Secretary for Educational Research and Improvement, the Panel to Evaluate the National Center for Education Statistics (NCES) was established in 1985 by the National Academy of Sciences. This report culminates an extensive two-year study of NCES and reflects the panel's broad view of the center's…

A review of followup study research is reported which focused on issues and trends in the evaluation of vocational education programs and their implications for human resource development. The analysis of representative studies selected from a survey of the literature is divided into four sections, one for each of four types of studies: (1)…

Four evaluation methods for determining educational policy are objectivism; subjectivism; emotive-imperative; and instrumentalism. For the objectivist, the rationale for undertaking an evaluation is based on empirical verification or non-verification of claims of existing policies or activities. Secondly, the objectivist is interested in…

The methodological parameters of evaluative research studies help to identify a conceptualization of the phenomenon under investigation. Holistic critiques that identify the conceptual models under which the research was conducted shed light on the validity of the disparate inferences made from a number of studies of schools and school…

This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with the application of outcome…

To make educational assessments and comparisons meaningful, dropout data must be collected according to the same definitions, by the same procedures, and over the same time periods. A 31-state pilot project represents an effort by the National Center for Education Statistics to standardize data collection about high school completion. (SLD)