A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…

Rescoring of Center for Occupational and Professional Assessment objective-referenced tests is decided largely by content experts selected by client organizations. A few of the test items, statistically flagged for review, are not rescored. Some of this incongruence could be due to the use of the biserial correlation (r-biserial) as an…

Provides an alternative analysis of the reliability associated with the van Hiele Geometry Test based on the assumption that the norm-referenced reliability coefficients provided by the developers were inappropriate. Discusses the agreement coefficient and the kappa coefficient. (YP)

Focusing on technical issues, this paper critiques proposed changes in assessment procedures at the further educational level (ages 16 through 18) in England and Wales. Major structural changes are taking place at this educational level, partly because of large scale youth unemployment. The two current examination systems for the final year of…

This meta-analysis explored how measuring student progress toward long vs. short-term goals affects achievement outcomes. Twenty-one controlled studies were coded in terms of measuring method (toward long- vs. short-term goals) and type of achievement outcome (probe-like vs. global achievement test). Analogues to analysis of variance conducted on…

Concerned with the failure of multiple choice tests to measure composition--as opposed to grammar and usage--skills, college researchers studied the value of using writing samples to place students in composition classes. Evaluating the writing samples of 300 incoming freshmen, they did not find a high correlation between sample scores and…

Four discrimination indices were compared, using score distributions which were normal, bimodal, and negatively skewed. The score distributions were systematically varied to represent the common circumstances of a military training situation using criterion-referenced mastery tests. Three 20-item tests were administered to 110 simulated subjects.…

Locally developed occupational tests were administered to 16- and 17-year-olds in a government-sponsored vocational education program in the United Kingdom over a six-month period in 1984. Job skills were tested in two occupational areas: use of a micrometer and invoice completion. Some performance tests were designed by researchers and some by…

This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…

Intended both to evaluate the California testing program's success in assessing student achievement in the basic skills and to suggest possible improvements in the program, this report includes an executive summary evaluating current testing procedures, describing experimental studies on new ways of testing and reporting testing information, and…

A variety of adults were surveyed on alternative strategies for the State of Louisiana's minimum competency testing program. Both individual and group interviews were conducted with teachers, local school district supervisors and program administrators, parents, and state board of education members. Participants discussed what a state testing…