This study examined the relationships between the evaluations obtained from standard setting panelists and changes in ratings between different rounds of a standard setting study that involved setting standards on different language versions of an exam. We investigated panelists' evaluations to determine if their perceptions of the standard…

Reviews a number of promising methods for setting performance standards and discusses their strengths and weaknesses. Outlines some areas for future research that address the role of feedback to panelists and validation efforts for performance standards among other topics. (SLD)

The purpose of this study was to examine the effect of pretest items on response time in an operational, fixed-length, time-limited computerized adaptive test (CAT). These pretest items are embedded within the CAT, but unlike the operational items, are not tailored to the examinee's ability level. If examinees with higher ability levels need less…

Compared simplified variations on the Angoff and Bookmark methods for setting cut scores on educational assessments with data from a grade 7 mathematics test (23 panelists in all). Although the Angoff method is more widely used, results show that the Bookmark method has some promising features. (SLD)

Tests are used for making decisions about students, including decisions about promotion, in-grade retention, and high school graduation. This article provides criteria for evaluating the technical quality of tests used for high-stakes decisions in education. The intent is to provide educators with information for evaluating their testing program.…

The "Mental Measurements Yearbook" (MMY) series has provided researchers and practitioners with availability and evaluative information about commercially available English-language tests for over 50 years. However, two myths exist that are believed by some users of these resources. The first myth is that there are some minimum quality…

This research addresses the question of the comparability of equal scores on the same test from children in different grades. The results indicate that the scores are comparable, and support the assignment of Iowa Tests of Basic Skills levels that match the child's developmental level. (Author)

The development and validation of professional development resource materials for teachers by the National Council on Measurement in Education and associated professional groups is described. The developed module contains a context-orienting vignette, instruction, practice exercises, hands-on experiences, small group topics, and homework problems.…

Many states use a statewide assessment strategy to evaluate districts on common measures. Because districts in Nebraska are not measured on common instruments, comparisons of district performance are difficult. The accountability model described in this paper contains three components related to school district performance on academic content…

Several extensions to the Angoff method of standard setting are described that can accommodate characteristics of performance-based assessment. A study involving 12 panelists supported the effectiveness of the new approach but suggested that panelists preferred an approach that was at least partially conjunctive. (SLD)

The student assessment tasks identified by administrators in a previous study (J. C. Impara, B. S. Plake, and J. J. Fager, 1993) as tasks they performed are crossed with the knowledge, skills, and abilities identified as requirements of administrators to perform those tasks. The resulting matrix may be useful in designing instructional programs.…

Proposed an accountably model that addresses the challenges of allowing school districts to choose the specific strategies they use to measure student performance and evaluated this model using data from multiple sources for all school districts in Florida. Findings identify three strategies that would be useful for this type of accountability…

The number of performance-based assessments is increasing rapidly, but to date there is no established procedure for setting standards on these assessments. This paper describes several extensions to the Angoff procedure to accommodate the characteristics of a performance-based assessment and presents the results of research in applying this…

Reports results of a study that compared the measurement competencies in student assessment of teachers, counselors, and school administrators. Draws implications for pre- and inservice training for professionals in education. (LKS)

Many school districts are developing assessments that incorporate both selected response and constructed response formats. Scores on these assessments can be used for a variety of purposes ranging from subject remediation to promotion decisions. These policy decisions are informed by recommendations for Minimum Passing Scores (MPSs) from standard…