Errors that occasionally manifest in examination papers and other educational assessment instruments can threaten reliability and validity. For example, a multiple choice question could have two correct response options, or a geography question containing an inaccurate map could be unanswerable. In this paper we explore this oft-neglected element…

Differential item functioning (DIF) analysis is a statistical technique used for ensuring the equity and fairness of educational assessments. This study formulates a new DIF analysis method using the information similarity index (ISI). ISI compares item information functions when data fits the Rasch model. Through simulations and an international…

In this policy brief, the author explores the problems with attainment measures when it comes to evaluating performance at the school level, and explores the best uses of value-added measures. These value-added measures, the author writes, are useful for sorting out-of-school influences from school influences or from teacher performance, giving…

This report was designed to provide information on the effectiveness of the high school mathematics program in Hawaii, including identification of deficiency areas. The Stanford Achievement Test of Academic Skills (TASK) Level 1 was administered to 10,154 tenth-grade students in October 1983. In general, the students did not perform as well as the…

This report was designed to provide information on the effectiveness of the mathematics instructional program in grade 2 in Hawaii, including identification of deficiency areas. The Stanford Achievement Test, Primary Level II, was administered in May 1984 to 12,106 students in grade 2. In general, these students performed better than the national…

Rater errors (rater severity, halo effect, central tendency, and restriction of range) are described, and criteria are presented for evaluating rating quality based on a many-faceted Rasch (FACETS) model. Ratings of 264 compositions from the Eighth Grade Writing Test in Georgia by 15 raters illustrate the discussion. (SLD)

This collection of four papers deals with problem solving and the measurement of problem solving. "Climbing Up the Competence Ladder: Some Thoughts on Meaningful Assessment of Problem-Solving Tasks in the Classroom" by K. C. Cheung uses the metaphor of a competence ladder to represent the problem-solving continuum with progressive…

This chapter provides an overview of statistical issues arising in work on educational assessment and school accountability, organized around some of the most consequential misunderstandings. The article proceeds via a series of nine vignettes describing misunderstandings of statistical uncertainty in educational assessment and school…