Rater training is an important part of developing and conducting large-scale constructed-response assessments. As part of this process, candidate raters have to pass a certification test to confirm that they are able to score consistently and accurately before they begin scoring operationally. Moreover, many assessment programs require raters to…

Background/Context: There is a deep and yawning chasm between the world of tests and testing practices as they ought to be and the actual tests and testing practices now imposed on American students, educators, and schools. That chasm of theory and practice is a function of the dominant paradigm of educational reform, with its theory of action…

This paper aims to analyse the fit between the "use" and "usefulness" of the EIKEN Grade 1 test as a valid and reliable instrument to measure second language proficiency. The recent re-positioning of the EIKEN Grade 1 test as an internationally recognised higher stakes test of English proficiency, which allows successful test…

This paper argues that special procedures for constructing assessment tools containing performance assessment tasks are unnecessary and that current test methodology can easily be generalized to complex performance assessment tasks without destroying the desirable characteristics of those tasks. Reasonable statistical requirements for sound…

As the first paper in a series of policy papers on high-stakes student assessment programs, this paper examined high school graduation tests. High stakes refers to the use of test results to make important decisions about the test taker. Whether to use a high school graduation test is an essential policy question that will be addressed in a…

This paper discusses how to determine whether a test was developed in a legally defensible manner, reviewing general issues, specific cases bearing on different types of test use, some evaluative dimensions, and evidence of test quality. Tests constructed and used according to existing standards will generally stand legal scrutiny. (SLD)

Detailed evidence is presented about the extent of generalization from high-stakes tests to other tests and about the instructional effects of high-stakes testing. Data are from grade 3 of a large, high-poverty urban district with large numbers of Black and Hispanic American students. The district's results in 1990 for two tests, designated Test B…