A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…

The decline in scholastic aptitude test ( SAT) scores does not signify that the quality of education is lower. To interpret this decline requires an understanding of the testing process, changing racial and sex mix of the test makers, changing lifestyle of youth, and the increase in the number of students taking the SAT. (Author/AM)

After reviewing the history and evolution of criterion referenced tests and citing the writings of other researchers, the author summarizes the current state of criterion referenced tests. They are used to measure an individual's status with respect to a well-defined behavior domain; the behavior domain can be well-ordered, structured, or…

There is a great deal to think about in a minimum competency program: What competencies? How to measure? When to measure? One minimum or many? How high the minimum? Minimums for students or for schools? What to do with the incompetent? (Author/IRT)

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

This paper addresses itself to the history and use of standardized aptitude and achievement tests for practical judgements about schools in New Jersey. In the author's opinion, school-wide aptitude testing is not a particularly useful practice when other types of information, particularly grades, achievement tests, and teacher's comments, are…

Some unfinished issues relating to achievement test theory that seemed implicit in the basic idea of criterion-referenced testing are reviewed, recognizing their importance in current studies of authentic assessment and performance-based tests. The future of performance-based evaluation is explored. (SLD)

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

The validity of criterion-referenced interpretations of the proficiency scales of the National Assessment of Educational Progress (NAEP) is discussed. A major goal of the NAEP scales is to describe student achievement in specific content areas from grade 3 (age 9 years) through grade 11 (age 17 years). The numerical values for NAEP scales are…

Focusing on technical issues, this paper critiques proposed changes in assessment procedures at the further educational level (ages 16 through 18) in England and Wales. Major structural changes are taking place at this educational level, partly because of large scale youth unemployment. The two current examination systems for the final year of…

This report discusses the merits of performance contracting in the light of recent performance contract experiment evaluations, and it provides guidelines for administrators who are considering the use of performance contracts. The merits of the OEO experiment and the interpretation of the results by the OEO and the Rand Corporation are discussed.…

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

The accountability movement in American education has received great clamors of attention in the past few years. This movement, in turn, suggests the need for particular data to inform responsible decision-making; the need for assessment instruments which can address the question of what is learned; and the need for strengthening the existing…

A sample (N=37) of currently published achievement tests was surveyed as to the availability of five types of technical data: (1) item selection techniques; (2) standardization; (3) types of norms; (4) types of validating data; and (5) types of reliability data. Recommendations for publishers and cautions for test users are given. (BS)

Evaluates whether the "Degrees of Reading Power" reading achievement test (1) is a testing and teaching tool; (2) is a valid reading assessment; (3) should be used for third grade; and (4) correlates with other reading tests. Questions whether the test's Readability Report information really reflects test scores. (SR)