Discusses the Standard Generalized Markup Language (SGML), which was adopted as an international standard for data description, data modeling, and interchange in October 1986, and explores its evolution from its technical completion to its adoption by the international market. (four references) (LAE)

A new approach for examining the quality of judgments from standard-setting judges using a Binomial Trials Model (BTM) is presented and illustrated with 26 judges from the Georgia High School Graduation Test. Results suggest that the BTM provides information not available from other methods. (SLD)

Responds to a negative evaluation of the National Assessment of Educational Progress (NAEP) by the National Academy of Sciences (NAS) and asserts that a review of the evidence for the NAEP performance standards indicates that there is support for the current approach to NAEP standard setting. Considers the scholarship of the NAS evaluation…

Takes issue with support of the standard setting process of the National Assessment of Educational Progress (NAEP) advanced by critics of the evaluation of the standard setting process by the National Academy of Sciences and asserts that the achievement level descriptions developed for the NAEP no longer adhere to policy statements defining the…

Reactions to the publication of the National Council of Mathematics (NCTM) "Standards", in both 1989 and 2000, revealed the extent to which differing sets of values and beliefs had divided the mathematical community. This paper rejoins the debate surrounding the "Standards", exploring some of the opposing points of view while offering some…

When one wants to set data reliability standards for a class of scientific inquiries or when one needs to compare and select among many different kinds of data with reliabilities that are crucial to a particular research undertaking, then one needs a single reliability coefficient that is adaptable to all or most situations. Work toward this goal…

Using meta-analysis, this research takes a look at studies included in a meta-analysis by R. Jaeger (1989) that compared the cut score set by one standard setting method with that set by another. This meta-analysis looks beyond Jaeger's studies to select 10 from the research literature. Each compared at least two types of standard setting method.…

This article responds to the "Standards for Evaluation of Educational Programs, Projects and Materials" by addressing three issues in qualitative research: (1) data quality; (2) data verification; and (3) collusion between evaluators and their sponsors. To be of maximum international value, the standards report needs more emphasis on…

Nearly all of the research on standard setting focuses on different standard setting methods rather than the interaction of group members and the instructions given to group members. This study explored the effect of deliberation style and the requirement to reach consensus on the passing score, on rater satisfaction, and on postdecision…

The kernel of the Angoff method of standard setting (W. Angoff, 1971) would seem to be the judgment of whether a minimally competent person could answer an item on a test correctly or not. So it would seem that any procedure that requires independent judgment of the correctness or incorrectness of a response to items for a minimally acceptable…

Judgmental standard setting approaches rely on the perceptions of experts about examinee performance on a test. Traditional standard setting methods ask panelists to estimate how well a randomly selected hypothetical examinee who is representative of a well-defined target group, usually a minimally competent candidate (MCC), will perform on each…

Two studies of variations of the Angoff method (W. Angoff, 1971) involving nine elementary school teachers in each case compared a yes/no estimation with a proportion correct estimation for setting cut scores. Both methods yielded essentially equal cut scores, but judges found the yes/no method easier to implement. (SLD)

Examines criteria for choosing between test-centered and examinee-centered methods of standard setting in empirical terms and in terms of whether the method is consistent with the model of achievement underlying test design and interpretation and the assessment methods being used. Contains 35 references. (Author/SLD)

Australia and New Zealand stand out as something of an anomaly in the international trend toward developing common standards for evaluation. The national professional association that covers evaluation in both countries, the Australasian Evaluation Society (AES), was one of the earliest and most proactive in developing a comprehensive code of…

One year before the National Education Summit, Congress had reauthorized the National Assessment of Educational Progress (NAEP) and created a National Assessment Governing Board to develop and oversee policy for the NAEP. In conjunction with the call to establish national education goals, efforts are being made to establish standards for…