In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

This publication contains 29 case studies offering lessons learned during a four year NSF-supported MAA project designed to support mathematicians and mathematics departments in the increasingly important challenge of assessing student learning. Three introductory essays set assessment in broader academic and national contexts; an appendix…