Administrative problems such as computer malfunction and power outage occasionally lead to missing item scores, and hence to incomplete data, on credentialing tests such as the United States Medical Licensing examination. Feinberg compared four approaches for reporting pass-fail decisions to the examinees with incomplete data on credentialing…

Making causal inferences from a quasi-experiment is difficult. Sensitivity analysis approaches to address hidden selection bias thus have gained popularity. This study serves as an introduction to a simple but practical form of sensitivity analysis using Monte Carlo simulation procedures. We examine estimated treatment effects for a school-based…

Traditional methods for examining differential item functioning (DIF) in polytomously scored test items yield a single item-level index of DIF and thus provide no information concerning which score levels are implicated in the DIF effect. To address this limitation of DIF methodology, the framework of differential step functioning (DSF) has…

Two major problems related to the identification of learning disabilities with individually administered achievement tests are discussed: (1) the appropriateness of standard versus developmental scores for determining the severity of discrepancy; and (2) the limitations of existing developmental score scales. Characteristics of the developmental…

Normal Curve Equivalents (NCEs), a new score system for standardized tests, are used by school districts in reporting results to federal funding agencies. The author uses a quiz format to answer questions on the use of NCE scores. (EGS)

A Friends for Education (FFE) survey revealed that no state is below the norm at the elementary school level on six nationally normed commercially available achievement tests. Tests use a norm group from the past for comparison, but FFE suspects that inaccurate initial norms and teaching the test may cause high scores. (SLD)

Officials of the United States Department of Education conclude that the pervasive "above average" achievement reported by J. J. Cannell (1988) results from a combination of testing practices and procedures among school testing programs. Causative factors of this paradox, dubbed the "Lake Wobegon Phenomenon," are discussed.…

Representatives of the Riverside Publishing Company discuss the "Lake Wobegon Phenomenon," the reported "above average" achievement of most elementary schools nationwide that was discussed by J. J. Cannell (1988) of the Friends for Education. More appropriate use of normative comparisons and more complete reporting of test…

The time-bound nature of test norms is discussed in light of the report of J. J. Cannell (1988) that a large majority of elementary schools report above average achievement on national achievement tests. Generally increasing levels of achievement are deemed to be responsible for this phenomenon. (SLD)

Recognizing the concerns raised by J. J. Cannell (1988), Science Research Associates (SRA) defends its norms. Trends in curriculum need to be monitored in addition to students' achievement levels. New norms are needed only when there is a significant shift in curriculum or student performance. (SLD)

Despite the skepticism of J. J. Cannell (1988) that commercial test scores reveal much about the real achievement level of students, there is ample evidence that at least some of the gains observed on standardized tests are legitimate. Standardized scores should be greeted with healthy skepticism when high, but taken very seriously when low. (SLD)

In response to J. J. Cannell's (1988) discussion of the reported "above average" achievement of the vast majority of public school systems nationwide, the nature of national norms is discussed. The public must be better informed about the interpretation of test results. (SLD)

This article presents a model that can be used by local school districts for reanalyzing standardized test results to obtain a more valid assessment of local learning objectives can be used to identify strengths/weaknesses of existing programs as well as individual students. (EGS)

Four publishers responding to the previous discussion agreed that American elementary achievement has improved, but evidence presented by the Secretary of Education confirms that few real improvements have occurred since "Nation at Risk." Commercial achievement tests provide falsely high scores (the Lake Wobegon Effect). (SLD)

The increased use of test scores as a measure of school quality is discussed. Legitimate and illegitimate practices of test preparation are considered. Some commercial test preparation programs are reviewed, with some conclusions about their effectiveness and desirability. (SLD)